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SUMMARY 


The  TEVCS/ARES  methodology  was  devised  to  assist  in  the  selection  and  optimization  of 
advanced  weapon  systems.  This  methodology  was  developed  by  McDonnell  Aircraft  Company 
and  the  Boeing  Aerospace  Company  under  contract  to  the  USAF.  The  Regression  Simulation  of 
Turbine  Engine  Performance  (RSTEP),  Task  IV  program  is  an  analytical  study  to  identify  and 
evaluate  alternate  approaches  that  may  be  used  in  TEVCS/ARES  procedures  to  produce  system 
regression  surfaces  that  more  accurately  reflect  the  trends  of  the  baseline  aircraft  design/mission 
analysis  program.  A second  objective  of  RSTEP  is  to  reduce  the  cost  of  data  generation  required 
by  the  TEVCS/ARES  procedures. 

The  study  was  conducted  by  Pratt  & Whitney  Aircraft  Group,  GPD,  with  airframe/mission 
data  provided  by  the  Boeing  Aerospace  Company.  This  data  was  consistent  with  the  data  base 
generated  during  the  ARES  program,  and  consisted  of  mission  related  output  for  over  600 
combinations  of  engine  and  aircraft  variables.  The  initial  data  (Phase  I)  had  TOGW  as  a 
dependent  variable.  A re-direction  early  in  the  program  resulted  in  a change  to  a data  base  with 
TOGW  as  an  independent  variable  (Phase  II). 

To  satisfy  the  objectives  of  the  program,  the  following  four  areas  were  selected  for 
investigation: 

• An  alternative  to  the  orthogonal  Latin  Square  (OLS)  design  selector  used  in 
TEVCS/ARES 

• Alternate  approaches  to  improve  the  form  of  the  regression  equation 

• The  effect  of  the  number  of  independent  variables  on  regression  accuracy 

• The  effect  of  the  number  of  data  points  on  regression  accuracy. 

A modified  Central  Composite  Design  (CCD)  pattern  was  chosen  for  the  RSTEP  study. 
This  design  selector  provided  a convenient  means  to  systematically  investigate  the  impact  of  the 
number  of  independent  variables  and  the  number  of  data  points  on  regression  surface  accuracy. 
As  part  of  the  study,  an  analysis  was  made  of  the  cost  of  engine  and  airframe/mission  data 
generation  required  for  the  OLS  and  CCD  design  selectors.  For  the  number  of  propulsion 
variables  selected,  the  results  show  that  the  OLS  cost  of  data  generation  is  2.5  times  that  of  the 
CCD  cost  for  a five  independent  variable  problem.  The  OLS  cost  was  almost  1.3  times  the  CCD 
cost  for  nine  and  ten  variable  problems. 

Four  methodologies  were  studied  to  improve  the  form  of  the  regression  equation:  (1) 
Transformations,  (2)  Role  Reversal,  (3)  Indirect,  and  (4)  Optimized  Polynomial  Exponent.  The 
study  results  indicate  that  Transformation  methodology  provides  the  single  most  significant 
accuracy  improvement  of  all  the  methods  studied,  with  Role  Reversal  yielding  a further 
significant  improvement.  For  the  Phase  I five  variable  data  set,  application  of  Transformation 
methodology  reduced  a 34%  maximum  error  of  the  traditional  regression  of  TOGW  to  12%  error. 
The  average  absolute  error  was  also  reduced  from  5.8%  to  3.6%.  The  application  of  Role  Reversal 
methodology  with  Phase  II  data  made  a further  significant  incremental  change  in  TOGW  from 
12%  maximum  error  to  7%.  The  average  absolute  error  was  also  further  reduced  to  2%  error. 

The  results  of  increasing  the  number  of  independent  variables  showed  that  the  TOGW 
regression  accuracy  levels  for  the  five,  six,  and  seven  variable  problems  were  similar,  with  a 
maximum  error  of  less  than  10%  and  average  absolute  errors  of  about  2.5%.  The  8-,  9-,  and  10- 
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variable  problems  seemed  to  form  another  group  with  accuracy  levels  from  12%  to  17%  for  the 
maximum  error,  but  with  only  a small  increase  in  the  average  absolute  error  to  about  3.5%.  There 
were  only  3 data  points  out  of  over  600  that  contributed  to  errors  greater  than  12%  and  these  were 
corner  points  with  limit  value  combinations  of  the  independent  variables. 

Hie  results  of  increasing  the  number  of  data  points  indicate  that  half  replication  of  the  CCD 
pattern  is  sufficient  for  5-  through  9-variable  problems,  and  quarter  replication  is  sufficient  for 
10-variable  problems. 

The  accuracy  of  the  takeoff  distance  and  landing  velocity  regressions  were  excellent,  with 
maximum  errors  less  than  2%  even  for  the  10- variable  problem.  Combat  g-load  accuracy  was  only 
slightly  less,  with  maximum  errors  of  about  4%  and  average  absolute  errors  of  1%  for  the  10- 
variable  problem.  The  regression  error  for  acceleration  time  was  less  than  5%  maximum  error  for 
5 through  7 variables,  and  less  than  10%  maximum  error  for  8 through  10  variables.  The  average 
error  for  the  acceleration  time  regression  was  less  than  1.5%  for  any  number  of  variables. 
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MOTION  I 
INTRODUCTION 


Advanced  weapons  system  selection  and  optimisation  is  a complex  procedure  due  to  the 
number  and  range  of  airframe,  propulsion,  and  miesion  variables  that  must  be  considered.  In 
response  to  the  Air  Force’s  need,  selection  and  optimization  procedures  were  developed  by 
McDonnell  Aircraft  Company  and  the  Boeing  Aerospace  Company  under  Turbine  Engine 
Variable  Cycle  Selection  Study  (TEVCS)  (Ref  1)  and  Airplane  Responsive  Engine  Selection 
Study  (ARES)  (Ref  2)  contracts.  Although  these  procedures  resulted  in  a significant  step  forward 
over  the  traditional  procedures  previously  used,  some  of  the  new  procedures  represented  a first- 
generation  solution  to  the  problem.  The  TEVCS/ARES  techniques  did  provide  a firm  base  upon 
which  improvements  could  be  built.  The  Advanced  Engine  Simulation  (AES)  (Ref  4)  program 
identified  problems  in  the  TEVCS/ARES  techniques  to  evaluate  airframe/propulsion  systems. 
These  problems  are:  poor  trend  predictions,  and  a need  to  reduce  the  coat  of  generating  data  for 
system  studies. 

RSTEP  Task  IV  is  an  analytical  study  to  develop  regression  procedures  which  will  alleviate 
the  problems  identified  in  AES.  The  specific  objective  is  to  identify  and  evaluate  alternate 
approaches  that  may  be  used  in  TEVCS/ARES  procedures  to  produce  system  regression  surfaces 
that  more  accurately  reflect  the  trends  of  the  baseline  aircraft  design/mission  analysis  program. 

To  accomplish  these  goals,  four  areas  were  selected  for  investigation:  (1)  the  data  selection 
pattern,  (2)  the  form  of  the  regression  equation,  (3)  the  number  of  independent  variables  and 
(4)  the  number  of  data  points.  The  Central  Composite  Design  (CCD)  pattern  was  selected  for 
this  study  to  provide  an  alternate  to  the  Latin  Square  design  used  in  TEVCS/ARES.  The  CCD 
pattern  also  conveniently  accommodated  the  systematic  study  of  increasing  the  number  of 
independent  variables  from  five  to  ten;  and  it  accommodated  the  systematic  study  of  the  number 
of  data  points.  Several  alternative  approaches  to  improving  the  accuracy  of  the  regression 
equations  were  also  investigated:  Transformations,  Role  Reversal,  Indirect  Methods,  and 
Optimized  Polynomial  Exponents.  Two  of  these  methods,  Transformations  and  Role  Reversal, 
provided  significant  improvements  in  accuracy. 
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SECTION  II 

PROBLEM  DEFINITION 


A.  ADVANCED  WEAPON  SYSTEM  SELECTION  PROCESS 

The  process  of  system  definition  to  meet  changing  system  requirements  can  be  lengthy  and 
can  involve  large  amounts  of  data.  To  establish  a weapon  system  which  best  meets  a set  of 
requirements,  various  configurations  must  be  selected  and  key  design  variables  established  for 
each  configuration.  A mission  analysis  is  then  performed  for  each  combination  of  independent 
variables  for  each  configuration  selected,  and  the  capability  of  each  system  defined.  The 
capability  is  then  compared  to  the  previously  established  requirements  and  figures-of-merit. 
Iterations  for  the  most  promising  configuration  are  performed  to  refine  system  capabilty  and  the 
optimum  variable  combinations  in  the  region  of  defined  interest  must  be  determined.  With  the 
traditional  individual  mission  analysis  approach,  it  is  possible  that  important  variables  and 
interactions  between  variables  may  be  ignored,  resulting  in  an  inferior  design. 

To  meet  the  need  for  system  selection  in  a timely,  thorough,  and  flexible  manner,  the  Air 
Force  formulated  the  Airplane  Response  Engine  Selection  (ARES)  and  Turbine  Engine  Variable 
Cycle  Selection  (TEVCS)  programs  to  develop  methodology  for  computerized  system  optimiza- 
tion at  the  airframe/engine  independent  variable  level.  This  methodology  uses  statistical 
approaches  for  evaluation  of  the  entire  independent  variable  design  space  to  ensure  that  all 
variable  combinations  are  investigated  and  uses  a surface  fit/search  procedure  to  determine  the 
optimum  configuration  selection.  The  Regression  Simulation  of  Turbine  Engine  Performance 
(RSTEP)  Task  IV  study  is  a follow-on  study  to  the  ARES  program. 

B.  ARE8  METHODOLOGY 

1.  Introduction 

The  ARES  methodology  is  shown  schematically  in  figure  1.  Briefly,  the  methodology  uses  a 
design  selector  to  select  independent  variable  combinations  and  levels;  performance  Simula  ton  to 
simulate  propulsion  system  and  vehicle  performance  and  determine  overall  system  performance 
levels;  a data  interpolator  that  correlates  the  system  performance  output  from  the  performance 
simulator  through  the  use  of  regression  analysis,  and  an  interpreter  that  interrogates  the 
performance  surfaces  that  result  from  the  regression  equations.  The  interpreter  incorporates 
optimizer  logic  that  uses  a search  technique  to  vary  independent  variable  levels  to  maximise 
system  performance  according  to  a selected  figure  of  merit.  This  procedure  is  described  in  more 
detail  in  the  following  paragraphs. 

2.  Description  of  Methodology 

The  methodology  begins  with  selection  of  a given  engine  type,  a given  airframe  type,  given 
inlet  and  nozzle  types,  and  a given  mission  role.  For  example,  the  engine  type  might  be  a mixed 
flow  afterburning  turbofan  and  the  airframe  type,  a variable  sweep  wing  with  podded  engines. 
The  inlet  might  be  a two-dimensional,  variable  ramp,  external-compression  type.  The  noaxle 
might  be  a variable  area  ratio  convergent-divergent  type. 

A performance  model  for  each  system  configuration  variable  must  be  created  and 
incorporated  into  either  an  airframe/mission  analysis  computer  deck  or  an  engine  performance 
deck.  The  performance  model  for  each  system  variable  is  parametric  in  the  sense  that  it  will 
i define  performance  for  that  system  element  (e.g.,  afterburning  turbofan)  for  ranges  in  key 

1 independent  design  variables  (e.g.,  fan  pressure  ratio  variations).  Thus,  an  overall  computer 

model  of  the  system  is  created  that  is  parametric  since  design  input  may  be  varied. 
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Combinations  and  levels  of  the  key  independent  design  variables  are  selected  for  use  in 
defining  overall  system  performance  hardpoints.  Levels  and  combinations  of  both  airframe 
associated  design  variables  (e.g.  aspect  ratio)  and  engine  associated  design  variables  are  selected. 
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Engine  performance  data  for  all  mission  segments  to  be  included  in  the  mission  analysis  are 
generated  for  all  selected  engine  associated  design  variable  levels  and  combinations.  An 
airframe/mission  deck  is  then  used  to  establish  the  system  performance  levels.  The  output  from 
the  airframe/mission  deck,  in  terms  of  the  dependent  variable  levels  (Take-Off  Gross  Weight, 
mission  segment  operating  thrust,  TSFC,  etc.)  associated  with  the  combinations  and  levels  of  the 
independent  variables  (airframe  thrust/weight,  cycle  overall  pressure  ratio,  etc.)  comprise  the 
data  base  for  the  ARES  methodology.  Since  the  data  base  includes  both  engine  associated  and 
airframe  associated  variables,  interaction  between  engine  and  airframe  variables  may  be  studied. 

A regression  program  is  used  to  fit  hypergeometric  surfaces  for  any  desired  dependent 
variable.  The  use  of  the  regression  equations  then  permits  interpolation  of  dependent  variable 
solutions  for  independent  variable  combinations  in  addition  to  those  comprising  the  data  base  to 
be  determined.  Thus,  the  expanded  data  base  (the  regression  equations)  actually  constitute  a 
series  of  multidimensional  surfaces  (one  for  each  dependent  variable  regressed);  where  the 
number  of  dimensions  is  the  number  of  independent  variables  in  the  regression  equations.  ARES 
used  2nd  order  polynomial  regression  equations  for  all  surface  fits. 

An  optimization  program  was  developed  under  the  ARES  program.  This  optimization 
program  searches  the  data  base  to  find  an  optimum  engine/airframe  design  combination  by 
minimizing  a specified  figure-of-merit  (e.g.,  TOGW)  or  maximizing  a payoff  function  (mission 
segment  range)  subject  to  constraints  on  specified  functions  (e.g.,  maximum  landing  velocity). 
The  optimization  analysis  uses  the  surface  fit  functions  provided  by  the  regression  equations  for 
its  payoff  and  constraint  functions.  The  program  incorporates  a penalty  function  technique  which 
incorporates  the  constraints  in  the  penalty  function  and  a gradient  search  technique  to  minimize 
the  penalty  function  to  solve  the  constrained  optimization  problem.  Any  number  of  optima  may 
be  found  and  analyzed  by  repeated  applications  of  the  procedure  with  different  combinations  of 
constraints  and  payoff  functions.  Since  this  procedure  is  entirely  computerized,  the  ARES 
methodology  offers  rapid  assessment  of  alternative  payoff  functions,  penalty  functions,  or 
constraint  bands.  Also,  because  the  number  of  variable  combinations  can  be  large,  the 
methodology  can  incorporate  both  engine  and  airframe  independent  variables.  Thus,  the  data 
base  includes  engine/afrframe  interactive  effects. 

9.  Limitations  In  tha  Methodology 

Experience  gained  under  the  ARES  and  the  AES  programs  has  identified  accuracy  and  cost 
as  two  dominant  limitations  of  the  TEVCS/ARES  methodology. 

Regression  equation  accuracy  was  determined  to  be  the  limiting  factor  in  the  overall 
accuracy  of  the  methodology.  In  some  cases,  the  accuracy  level  was  found  insufficient  for 
adequate  identification  of  the  optimum  independent  variables. 

The  large  propulsion  data  base  required  for  the  ARES/TEVCS  evaluation  process  comprises 
a large  part  of  the  total  data  generation  costs.  Typically,  400  to  600  points  per  engine  consisting 
of  altitude,  Mach  number  and  power  setting  combinations  were  generated  during  the  ARES 
evaluation.  The  orthogonal  Latin  Square  selection  procedure  required  a minimum  of  121  specific 
engines  for  a 10-independent  variable  case  (with  five  propulsion  variables)  resulting  in  a 
requirement  of  approximately  60,000  engine  data  points.  Based  on  experience  in  ARES,  the 
Boeing  Company  estimated  that  the  propulsion  data  generation  costs  comprised  70%  of  the  total. 
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The  ARES/TEVCS  procedure*  tend  to  be  front-end  loaded  in  that  a good  deal  of  time  and 
effort  can  be  expended  before  result*  become  visible.  Consequently,  it  is  usually  necessary  for  the 
engine  company  to  conduct  preliminary  screening  of  advanced  concepts  to  identify  those  that 
have  potential.  Avoidance  of  propulsion  system  concepts  with  limited  potential  is  essential  to  the 
effective  expenditure  of  resources.  It  is  therefore  advantageous  to  screen  new  concepts  baaed  on 
a realistic  airframe  data  base  during  the  concept  formulation  stage. 

C.  PROGRAM  APPROACH 

The  principal  objectives  of  the  RSTEP  Task  IV  study  are  to  identify  and  evaluate 
alternative  approaches  to  improve  the  accuracy  of  the  TEVCS/ARES  procedures  used  for 
conceptual  airframa/engine  system  design  studies,  and,  to  reduce  the  cost  of  generating  data. 
Relative  to  the  AES  methodology  previously  discussed,  the  Design  Selector  and  Data  Interpolator 
procedures  are  to  be  studied,  and  techniques  for  accuracy  improvement  and  cost  reduction  are  to 
be  identified.  In  order  to  satisfy  these  requirements,  four  areas  were  selected  for  investigation: 

• An  alternative  to  the  orthogonal  Latin  Square  design  selector 

• Alternative  approaches  to  improve  the  equation  form 

• The  effect  of  numbers  of  independent  variables  on  accuracy 

• The  effect  of  numbers  of  data  points  on  accuracy. 

A modified  Central  Composite  Design  (CCD)  pattern  was  selected  for  this  study  to  provide 
an  alternative  to  the  Latin  Square  design  selector  used  in  TEVCS/ARES.  A discussion  of  this 
design  selector  is  provided,  and  a comparison  of  the  data  requirements  and  cost  is  made  with  the 
Latin  Square  procedure.  The  CCD  pattern  provided  an  economical  means  to  build  from  a 
5-variable  problem  to  a 10-variable  problem  so  that  the  impact  of  the  number  of  independent 
variables  could  be  systematically  studied.  The  CCD  pattern  also  provided  a convenient  means  to 
investigate  the  effect  of  numbers  of  data  points  used  in  the  regression  analysis  for  each  number 
of  independent  variables. 

A large  number  of  possible  approaches  to  improve  the  accuracy  of  the  regression  equations 
was  evaluated,  including  several  that  are  unique  to  this  study.  These  approaches  have  been 
grouped  into  four  methodologies.  Each  of  these  methodologies  is  considered  individually,  and  the 
improvements  attributed  to  each  methodology  are  identified. 

The  four  methodologies  are  briefly  defmed  as  follows: 

1.  Transformation  Methodology  — This  is  the  use  of  functions  of  a dependent 
variable  (e.g.  log  TOGW)  to  provide  various  amounts  of  “weighting”  to  the 
least  squares  error  function. 

2.  Role  Reversal  — The  role  of  a variable  is  traditionally  defined  as  independent 
if  it  is  an  input  variable,  and  dependent  if  it  is  an  output  solution.  The  Role 
Reversal  technique  regresses  one  of  the  independent  variables  as  a function 
of  both  the  dependent  variable  and  the  remaining  independent  variables. 

3.  Indirect  Methodology  — This  method  utilizes  physically  derived  rela- 
tionships in  an  effort  to  improve  regression  accuracy.  Usually  two  or  three 
regression  equations  are  required  to  define  the  desired  dependent  variable  in 
terms  of  the  independent  variables. 


4.  Optimised  Polynomial  Exponent  — This  method  is  designed  to  improve  the 
regression  accuracy  by  determining  the  best  polynomial  exponents  and  order 
of  the  croee-product  terms. 
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SECTION  III 

TECHNICAL  DISCUSSION 


A.  RSTEP  VARIABLES  AND  DATA  BASES 

Development  of  the  data  used  in  the  Regression  Simulation  of  Turbine  Engine  Peformance 
(RSTEP)  Task  IV  study  was  a joint  effort  by  Pratt  & Whitney  Aircraft/Govemment  Products 
Division  and  The  Boeing  Aerospace  Company.  A P&WA  parametric  gas  turbine  engine  cycle 
matching  program  was  used  by  Boeing  to  calculate  preliminary  steady-state  engine  performance 
data  for  a wide  range  of  cycle  variable  combinations.  Aircraft  performance  was  also  calculated  by 
Boeing  using  the  Boeing  Engine  Airplane  Matching  (BEAM)  program.  This  work  was  performed 
under  contract  to  P&WA. 

The  P&WA  parametric  engine  computer  program  used  in  the  RSTEP  Task  IV  study  is 
identical  to  that  used  in  the  Airplane  Response  Engine  Selection  (ARES)  study,  and  provides 
performance  and  weight  estimates  for  a fixed  turbine  geometry,  mixed  flow  afterburning  turbofan 
(P&WA  computer  deck  CCD  0234-03.0).  Boeing  Company  provided  inlet  and  nozzle  performance 
characteristics. 

The  Boeing  airplane  definition  used  in  the  RSTEP  Task  IV  study  is  also  the  same  as  used 
in  the  ARES  study.  This  model  represents  a tactical  advanced  technology  aircraft,  with  fixed 
wing  sweep,  side  mounted  2-D  horizontal  ramp  inlets,  and  conformally  carried  weapons.  The 
airplane  model  incorporates  1986  IOC  technology  throughout.  The  mission  simulated  was  the 
same  as  the  supersonic  dash  interdiction  mission  used  in  the  ARES  study.  The  mission  profile  is 
presented  in  figure  2.  The  distance  from  take-off  to  the  start  of  dash  (and  the  return  from  end  of 
dash)  was  held  fixed  at  300  nm.  For  Phase  I of  the  study,  the  dash  radius  (RADIUS)  was  also  held 
constant  (100  nm),and  the  airplane  TOGW  was  a fall-out.  For  Phase  II,  the  Take-Off  Gross 
Weight,  lb,  (TOGW)  was  fixed  (an  independent  variable),  and  the  supersonic  dash  radius  was  a 
fall-out. 


Optimum 


Sizing  Points: 

• Acceleration  Time  (0.85-1. 6/30K) 
e Load  Factor  (0.9/30K) 

n>  194479 

Figure  2.  Interdiction  Miuion 


8 


r 


i 

i 

i 


Three  data  seta  will  be  referred  to  within  the  report.  Each  of  the  data  sets  is  unique,  because 
each  has  different  independent  variables.  The  first  is  a data  set  used  in  the  ARES  study.  This 
data  set  was  not  used  in  the  RSTEP  Task  IV  study,  but  is  included  for  comparison.  The  other  two 
data  seta  were  used  in  the  RSTEP  Task  IV  study,  and  are  referred  to  as  Phase  I data  and  Phase 
II  data.  A tabulation  of  the  respective  independent  variables  for  these  data  sets  is  shown  in 
table  1. 


Table  I.  Independent  Variables  Used  in  ARES  and  RSTEP  Task  IV 


Variable 

Number 

ARES 

RSTEP  Taik  IV 
Phase  I 

RSTEP  Talk  IV 
Phase  II 

Levels  of  Variables  Studied 
Low  Medium  High 

1 

FPR 

BPR 

BPR 

0.20 

1.0 

1.80 

2 

TR 

TR 

TR 

1.00 

1.07 

1.16 

3 

W/S 

W/S 

W/S 

80 

100 

120 

4 

T/W 

T/W 

T/W 

0.70 

1.00 

1.30 

5 

SWP 

SWP 

TOGW 

40,000 

60,000 

80,000 

6 

CET 

CET 

2400 

2700 

3000 

7 

AR 

SWP 

36 

60 

66 

8 

AS 

A8 

-1 

0 

+1 

9 

OPR 

OPR 

20 

26 

30 

10 

t/c 

AR 

1.5 

2.5 

3.6 

TOGW 

60,000  lb 

Dependent  Variable 

Variable 

AR 

Independent  Variable 

Scheduled 

Independent  Variable 

t/c 

Independent  Variable 

Fixed 

Fixed 

RADIUS 

Dependent  Variable 

Fixed 

Variable 

For  the  Phase  I data,  TOGW  was  selected  as  the  dependent  variable  for  a fixed  value  of 
RADIUS.  As  a result  of  evaluation  of  the  five  variable  Phase  I data,  the  decision  was  made  to 
change  the  procedure  and  calculate  RADIUS  (the  dependent  variable),  and  select  TOGW  as  one 
of  the  independent  variables.  The  complete  study  was  then  made  with  Phase  II  data.  The 
decision  to  change  to  the  Phase  II  data  set  was  made  for  the  following  reasons:  (1)  It  was 
suggested  that  RADIUS  could  be  fit  more  accurately  than  TOGW,  (2)  some  combinations  of 
independent  variables  produced  unrealistically  large  TOGW’s,  or  could  not  converge  to  a 
solution,  and  (3)  it  takes  less  computer  time  to  calculate  RADIUS  for  a given  TOGW. 

Boeing  conceived  the  concept  of  negative  dash  radius  to  provide  RADIUS  values  for  all 
combinations  of  independent  variables.  The  choice  of  TOGW  as  an  independent  variable  turned 
out  to  provide  additional  flexibility  and  improved  regression  accuracy  as  a result  of  Role  Reversal 
and  Quadratic  solution  methods  which  were  developed  in  this  study. 

Although  regressions  of  TOGW  and  RADIUS  received  the  most  attention  in  this  study, 
regressions  of  take-off  distance  (T.O.  distance),  combat  acceleration  time  (accel  time),  combat 
load  factor  (g-Ioad),  and  landing  velocity  (velocity)  were  also  made  to  determine  if  any  unique 
problems  developed. 

A listing  of  the  Phase  II  data  including  values  of  independent  and  dependent  variables  is 
presented  in  Appendix  A. 

B.  DATA  SELECTION  PATTERNS 

The  design  selection  patterns  in  common  use  are  described  briefly  below: 

1.  Orthogonal  Latin  Squara  (OLS) 

The  TEVCS/ARES  procedure  uses  the  orthogonal  Latin  square  method  to  select 
independent  variable  combinations  for  examination.  A detailed  description  of  the  OLS  procedure 
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ia  not  presented  in  this  report  because  this  information  is  available  in  the  TEVCS  and  ARES 
reports  (Ref  1 and  2).  Briefly,  a Latin  Square  is  an  array  of  numbers  (or  objects)  which  are 
arranged  in  such  a way  that  each  number  appears  once  and  only  once  in  each  row  and  column 
combination.  For  the  three  variable  case  a cube  can  be  visualized  in  three  dimensions  with  data 
points  appearing  only  once  in  each  row/column  combination.  See  figure  3.  One  advantage  of  this 
method  is  that  only  a small  number  of  data  points  are  required  for  large  (e.g.  10)  numbers  of 
independent  variables.  One  of  the  disadvantages  is  that  a large  number  of  engines  are  required 
in  the  design  matrix;  a different  engine  for  each  data  point.  The  number  of  data  points  is  evenly 
distributed  in  design  space  with  no  possible  correlation  between  variables. 


ID  1M4TC 


Figure  3.  Isometric  of  Three  Variable  Latin  Squares  Pattern 
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Under  Advanced  Engine  Simulation  Study  (AES),  provision  was  made  to  revert  to  the 
traditional  approach  of  determining  system  optimum  and  its  drivers  if  the  accuracy  problem  was 
too  great,  the  traditional  approach  being  an  evaluation  of  the  figure-of-merit  by  varying  one 
independent  variable  at  a time.  As  it  turned  out,  accuracy  was  a problem,  and  it  was  elected  to 
combine  the  traditional  approach  with  a regression  analysis  approach  based  on  a variation  of  the 
central  composite  design  (CCD)  pattern  that  had  been  used  several  times  by  P&WA  in  previous 
system  studies.  Five  of  the  key  independent  variables  were  selected  for  regression  analysis:  Fan 
Pressure  Ratio  (FPR),  Throttle  Ratio  (TR),  Thrust  to  Weight  Ratio  (T/W),  Wing  Loading  (W/S), 
and  Wing  Leading  Edge  Sweep  Angle  (SWEEP).  The  result  was  successful,  and  the  trend  curves 
obtained  from  the  regression  equations  satisfactorily  matched  those  obtained  from  the  data 
points. 

S.  Cuntrel  Compos  It*  Design  (CCD) 

Central  composite  design  patterns  in  many  variations  are  in  common  use  in  response 
surface  methodology.  The  pattern  for  a three  variable  case  can  be  visualized  in  three  dimensions 
as  a cube  with  a data  point  at  each  comer,  a point  in  the  center  of  each  face,  and  a point  in  the 
center  of  the  cube,  as  shown  in  figure  4. 


jx2 


Figure  4.  Isometric  of  Three  Variable  Central  Composite  Design  Pattern 


With  this  design  pattern,  many  cross-plots  can  readily  be  made  and  cross-coupling  terms 
defined.  As  the  number  of  independent  variables  increases,  the  number  of  comer  points  goes  up 
dramatically  (2"),  while  the  number  of  face  points  only  increases  by  2n.  It,  therefore,  becomes 
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expedient  to  reduce  the  number  of  comer  points  to  reduce  the  cost  of  data  generation.  The 
equation  for  number  of  points  becomes: 

-|I-  + 2n  - 1 

for  k - 0 all  comer  points  are  used  (hill  replication) 

k = 1 one-half  the  comer  points  are  used  (half  replication) 
k * 2 one-quarter  of  the  comer  points  are  used  (quarter  replication) 
k ■ 3 one-eighth  of  the  comer  points  are  used  (eighth  replication) 

The  5-variable  Phase  II  data  pattern  is  shown  in  figure  5. 

The  solid  points  shown  are  included  in  the  half  replication  pattern,  while  all  the  points 
shown  are  used  in  the  full  replication  pattern.  In  data  generation,  the  low  (L),  mid  (M),  and  high 
(H)  values  of  a variable  are  not  always  the  same.  At  some  of  the  comer  points  where  upper  and 
lower  limit  combinations  of  a variable  are  to  be  used,  a converged  solution  is  not  always 
obtainable.  For  example,  because  of  constraints  built  into  the  parametric  engine  cycle  deck,  a 
1.6  BPR  is  the  highest  (compared  to  the  nominal  high  of  1.8  BPR)  that  can  be  obtained  with  the 
high  value  of  throttle  ratio  and  the  low  value  of  turbine  temperature.  Data  for  the  1.6  BPR  engine 
was  substituted  for  that  point,  and  the  value  of  1.6  was  used  for  the  independent  variable  (BPR) 
in  the  regression  analysis.  This  procedure  did  not  appear  to  cause  any  problems  in  the  regression 
analysis,  and  allowed  generation  of  all  data  to  meet  the  pattern  requirements. 

Table  2 presents  the  number  of  data  points  required  as  a function  of  the  number  of  variables 
for  both  the  CCD  and  OLS  patterns. 

The  number  of  points  shown  for  the  OLS  design  results  from  a criteria  that  the  number  of 
points  must  be  equal  to  integer  powers  of  prime  numbers.  For  full  replication  CCD  pattern,  the 
number  of  data  points  increases  significantly  for  the  CCD  pattern  as  the  number  of  variables 
increases.  For  this  reason,  it  becomes  desirable  to  reduce  replication  at  high  numbers  of  variables. 
As  the  comer  points  are  eliminated,  the  ability  to  obtain  desired  cross  plots  diminishes  and 
confounding  of  effects  of  variable  cross  products  can  occur.  One  of  the  objectives  of  this  study  is 
to  determine  the  lowest  replication  which  provides  acceptable  accuracy  for  each  number  of 
variables.  A reasonable  goal  would  be  to  achieve  acceptable  accuracy  with  quarter  replication  of 
10  variables. 

Even  though  the  required  number  of  data  points  can  be  large  for  a 10-variable  problem,  the 
number  of  engine  cycle  combinations  required  would  be  small.  The  required  number  of  engine 
cycles  for  a given  number  of  engine  variables  can  be  obtained  from  table  2 by  interpreting 
“number  of  variables”  as  “number  of  engine  variables"  UBing  full  replication  values.  Hence,  even 
with  a 10-variable  problem,  only  43  engine  cycle  combinations  would  be  required,  assuming 
6 engine  variables.  With  the  current  distribution  of  data  cost  generation,  the  121  points  used  in 
Latin  squares  could  be  increased  to  about  400  points  for  a CCD  pattern  for  the  same  cost.  This 
gTeatly  improves  the  pattern  density,  which  is  always  an  advantage. 
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Table  2.  Variation  of  Data  Points  With  the  Number  of  Independ- 
ent Variables 


Number  of  Variable t 

3 

4 

5 

6 

7 

8 

9 

10 

Number  of  Point*: 

Orthogonal 

Latin  Square 

16 

26 

49 

49 

64 

81 

121 

121 

CCD 

full  replication  (k  = 0) 

16 

2b 

43 

77 

143 

273 

631 

1,046 

H replication  (k  3 1) 

11 

17 

27 

46 

79 

146 

276 

533 

replication  (k  - 2) 

H replication  (k  « 3) 

All  Poeaible  Interactions 

27 

81 

243 

729 

2,187 

81 

6,661 

147 

19,683 

277 

149 

69,049 

(Three  Levels) 

C.  R8TEP  TASK  IV  DATA  SELECTION 

A modified  Central  Composite  Design  (CCD)  data  selection  pattern  was  selected  for  use  in 
the  RSTEP  Task  IV  study.  The  CCD  pattern  offers  several  advantages  for  this  type  of  study: 
(1)  defined  replication  patterns  provide  a methodical  way  to  study  the  effects  of  numbers  of  data 
points,  and  (2)  commonality  of  data  points  for  all  variables  studied  provides  a potential  cost 
saving  compared  to  the  Latin  Squares  approach. 

Table  3 shows  the  CCD  variable  replication  combinations  selected  for  study  to  minimize 
costs  of  data  generation. 


Table  3.  Replication  Patterns  Selected  for 
Study 


Number*  of  Variable * 

5 

6 

7 

8 

9 10 

Full  Replication 

X 

X 

X 

X 

Half  Replication 

X 

X 

X 

X 

X 

Quarter  Replication 

X 

X X 

The  CCD  data  selection  pattern  is  a fractional  factorial  design  experiment  and  as  such  there 
are  fractional  replication  patterns  of  the  experiment.  The  fractional  replications  are  defined  and 
can  be  used  to  methodically  select  reduced  numbers  of  data  points  from  within  a full  data  set  in 
order  to  study  the  effects  of  reduced  numbers  of  data  upon  regression  accuracy. 

The  procedure  used  in  this  study  was  to  calculate  the  5-variable  data  set  holding  all  the 
other  independent  variables  at  a fixed  value.  Then  additional  independent  variables  are  added 
one  at  a time  until  10  independent  variables  have  been  evaluated.  As  the  number  of  variables  is 
increased  in  this  fashion,  many  of  the  data  points  that  are  required  for  the  new  variable  are 
common  with  those  calculated  for  previous  cases.  This  provides  economy  in  data  generation  as 
additional  variables  are  added.  The  advantages  of  commonality  of  data  points  for  the  CCD 
pattern  can  be  seen  in  table  4,  which  shows  the  number  of  data  points  required  for  each  level  of 
replication  of  5 through  10  variables.  In  addition,  the  number  of  points  each  variable  has  in 
common  with  previous  variables  is  shown  in  column  2.  Column  3 shows  the  total  numbers  of  data 
points  generated  for  each  variable-replication  combination,  including  those  data  points  that  are 
common  to  previous  results.  Data  points  that  are  eliminated  fall  into  the  category  of  check  points 
which  are  data  points,  excluded  from  the  regression  data  set,  but  are  available  for  inspection.  One 
source  of  these  check  points  is  data  points  left  over  when  half  (or  quarter)  replication  of  a variable 
| is  studied,  but  full  (or  half)  replication  data  are  available.  A progressively  larger  source  of  check 

| points  is  also  available  as  the  number  of  variables  is  increased  because  not  all  points  used  with 
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the  leaser  number  of  variables  is  required  at  the  increased  variable  number  level.  Values  of  the 
independent  variables  for  each  check  point  are  substituted  into  the  regression  equation  to 
determine  the  value  of  the  dependent  variable  for  each  check  point.  The  value  of  the  calculated 
dependent  variable  can  then  be  compared  (checked)  with  the  appropriate  check  data. 

Table  4.  CCD  Pattern  Data  Point  Requirements  Variable  Build-Up  Pro- 
cedure 


Total  Point* 
Generated 


Number  of  Variable*,  n 
Replication 

Point*  Required 
For  CCD 

Point*  Common 
To  Prtuiou* 
Variable 

by  Build-Up 
From  5 
Variable* 

Total  Check 
Point * 
Available 

Full 

43 

0* 

43 

0 

6 

Half 

27 

0* 

43 

16 

Quarter 

— 

— 

— 

— 

Full 

77 

33 

87 

10 

6 

Half 

46 

17 

87 

42 

Quarter 

— 

— 

— 

— 

Full 

143 

66 

166 

22 

7 

Half 

79 

33 

166 

86 

Quarter 

— 

— 

— 

— 

Full 

273 

129 

309 

36 

8 

Half 

146 

66 

309 

164 

Quarter 

81 

33 

309 

228 

9 

Full 

Half 

Not  Considered 
276 

129 

466 

180 

Quarter 

147 

66 

466 

306 

10 

Full 

Half 

Quarter 

Not  Conaidered 
Not  Considered 
277 

129 

603 

326 

•Starting  with  S variable-fall  replication  pattern. 


0.  OL8  VS  CCD  COST  COMPARISON 

One  of  the  objectives  of  this  study  was  to  reduce  the  cost  of  data  generation.  Although  the 
orthogonal  Latin  Square  was  not  directly  evaluated  as  part  of  this  study,  an  analysis  was  made 
of  the  cost  of  engine  data  generation  and  the  cost  of  BEAM  airframe/mission  data  generation. 
These  results  were  then  used  to  estimate  the  data  generation  costs  for  the  OLS  and  CCD  design 
selectors. 

Table  5 presents  the  number  of  data  points  by  type  (i.e.,  numbers  of  engine  combinations 
and  number  of  independent  variables,  as  used  in  this  study).  The  number  of  data  points  shown 
for  the  OLS  data  selector  are  the  values  recommended  by  Boeing,  based  on  their  experience  from 
ARES  and  other  studies.  The  number  of  data  points  shown  for  the  CCD  data  selector  are  based 
on  the  results  of  this  study,  as  will  be  shown  in  the  Presentation  of  Results.  Note  that  for  5-  and 
6-variable  problems,  the  OLS  design  selector  requires  more  data  points  than  the  CCD  design 
•elector,  but  at  higher  numbers  of  independent  variables,  the  reverse  is  true.  However,  in  all 
cases,  the  number  of  engine  cycles  that  require  data  generation  is  always  much  less  for  the  CCD 
pattern.  Since  the  cost  to  generate  engine  data  is  much  higher  than  the  cost  to  generate 
airframe/mission  data,  there  will  be  a reduction  in  the  total  cost  of  CCD  data  generation.  At  the 
same  time,  the  CCD  design  selector  provides  more  than  twice  the  data  (for  9 and  10  variables)  for 
potentially  improved  regression  accuracy. 
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Table  5.  Design  Selector  Case  Comparison 


Independent  Variables 

Orthogonal  Latin  Souares 

Central  Composite  Design 

Notes 

Total 

A/C 

Enf 

Total 

A/C 

Eng 

Total 

A/C 

Eng 

6 

3 

2 

49 

49 

49 

27 

16 

9 

Half  Replication 

6 

3 

3 

49 

49 

49 

46 

16 

16 

Half  Replication 

7 

4 

3 

64 

64 

64 

79 

26 

16 

Half  Replication 

8 

4 

4 

81 

81 

81 

146 

26 

26 

Half  Replication 

9 

4 

5 

121 

121 

121 

276 

26 

43 

Half  Replication 

10 

5 

5 

121 

121 

121 

277 

43 

43 

Quarter  Replication 

t 
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Table  6 presents  the  relative  cost  of  data  generation  for  10  variable  OLS  and  CCD  data 
patterns.  In  this  example,  it  can  be  seen  that  the  cost  of  the  OLS  engine  data  generation  is  more 
than  the  total  cost  of  data  generation  for  the  CCD  pattern.  And,  the  total  cost  of  OLS  data 
generation  is  29%  more  than  that  of  the  CCD  pattern.  Furthermore,  the  pattern  for  the  engine 
data  represents  full  replication  data  of  the  engine  independent  variables;  therefore,  the  engine 
data  itself  can  be  regressed  and/or  used  in  other  studies  with  different  numbers  of  non -engine 
independent  variables. 


Table  6.  Ten  Variable  Case  Cost  Comparison  Five 
Airframe,  Five  Engine  Variable 


CCD  V,  Repl 

Latin  Squares 

Number  of  Engine* 

43 

121 

Number  of  Aircraft 

43 

121 

Total  Missions 

277 

121 

Cost  of  Engine  Data 

0.44 

1.02 

Cost  of  Missions 

0.66 

0.27 

Total  Cost 

1.00 

1.29 

Figure  6 presents  the  total  cost  of  OLS  data  generation  relative  to  CCD  data  generation 
total  cost.  For  5-independent  variables,  the  OLS  cost  is  2.5  times  the  CCD  cost.  The  OLS  cost 
relative  to  the  CCD  cost  generally  decreases  with  increasing  numbers  of  variables,  but  at  the  9- 
and  10-variable  level,  the  OLS  cost  is  still  29%  greater  than  the  CCD  cost. 

tt.  REGRESSION  ANALYSIS  METHOD 

The  regression  technique  employed  in  RSTEP  Task  IV  is  a classical  least  squares  procedure 
utilizing  a pivoting  matrix  inversion  subroutine.  This  particular  computerized  regression  routine 
is  capable  of  handling  multiple  variable,  non-integer  power,  polynomial  foams.  The  routine  has 
backward  elimination  capability  using  a t-statistic  criteria.  Normalization  of  variables  was  not 
used  since  it  was  determined  that  normalization  has  no  impact  upon  the  accuracy  of  surface  fits. 

Hie  regression  routine  was  modified  and  incorporated  into  a computer  program  with 
automated  data  handling  capabilities  as  a convenience  for  handling  BEAM  output  and  for 
evaluating  methode  developed  in  this  study.  The  capabilities  include: 

• Transformation  and  retransformation  of  dependent  variables  for  both 
regressed  and  check  data. 

• Calculation  of  quadratic  solutions  for  independent  variables  from  2nd  order 
polynomial  regression  equation  forms. 
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• Error  statistic  analysis  for  indirect  methods  that  use  regressed  variables  as 
independent  and  dependent  variables. 

A sample  computer  printout  from  this  routine  is  presented  in  Appendix  B for  a 7-variable 
half  replication  case. 


Number  of  Variables 

TO  146443 


Figure  6.  Relative  Data  Generation  Cost  Comparison 
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SECTION  IV 

DISCUSSION  OF  TECHNIQUES 


A.  TRANSFORMATION  METHODOLOGY 
1.  Transformation  Davalopmant  — Phasa  I Data 

The  first  and  most  important  of  the  five  methodologies  presented  is  the  Transformation 
method.  Transformation  methods,  as  defined  in  this  report,  utilize  functions  of  the  dependent 
variable  (e.g.  log  TOGW)  to  obtain  better  regression  surface  accuracy.  Transformations  of  this 
type  are  equivalent  to  regressing  a dependent  variable  in  terms  of  multiple  order,  multiple  term 
power  functions.  Although  use  of  this  method  is  not  new,  the  interpretation  of  the  use  of  the 
transformations  and  the  development  of  a parametric  family  of  transformations  is  believed  to  be 
unique  to  this  study. 

As  noted  previously,  the  study  utilized  two  data  sets,  Phase  I data  and  Phase  II  data. 
Transformation  methods  have  been  applied  to  both  data  sets,  although  the  development  of  the 
systematic  approach  was  evolved  during  the  study  of  Phase  I data. 

Five  engine/aircraft  variables  were  considered  in  Phase  I.  Traditional  least  squares 
quadratic  regression  of  the  dependent  variable  TOGW  as  a function  of  Wing  Loading  (W/S), 
Byp*o«  Ratio  (BPR),  Throttle  Ratio  (TR),  Thrust  to  Weight  Ratio  (T/W),  and  Leading  Edge 
Sweep  Angle  (SWEEP)  resulted  in  errors  greater  than  30%.  For  dependent  variables  that  have  a 
wide  range  of  values  over  a design  region,  the  least  squares  procedure  tends  to  result  in  smaller 
percentage  errors  at  large  values  and  larger  percent  errors  at  small  values.  This  happens  because 
the  least  squares  procedure  minimizes  the  sum  of  the  squares  of  the  differences  and  not  the  sum 
of  the  squares  of  the  percent  differences.  As  shown  in  figure  7,  the  difference  between  observed 
and  regrossed  values  (A  TOGW)  varies  over  a wide  range  (46k  — 153k)  of  values  of  TOGW. 
Transformations  of  the  dependent  variable  can  be  used  to  produce  a more  uniform  percentage 
error  distribution  over  the  range  of  values  of  a dependent  variable;  or,  to  improve  the  accuracy  of 
either  the  small  or  large  value  end  of  the  dependent  variable  range.  One  method  of  interpreting 
transformations  is  to  consider  them  as  analogous  to  providing  various  amounts  of  weighting  to  the 
least  squares  error  function.  This  is  not  to  be  confused  with  the  classical  weighting  function 
normally  used  in  regression  analysis. 

If,  for  example,  we  examine  function  y = log  (TOGW),  the  differential  of  this  function  is 
given  by  Ay  = A TOGW/TOGW,  the  criterion  of  least  squares  minimizes  an  error  function  (Ay)* 
= (yob**;..,— i - ycslculsted)'-  Because  0f  the  log  transformation,  minimizing  the  sum  of 
(Ay)1  is  analogous  to  minimizing  the  sum  of  the  squares  of  percent  error  of  the  original  dependent 
variable,  TOGW.  The  log  transformation,  in  effect,  “weights”  the  error  differences  (ATOGW)  by 
the  inverse  of  the  value  of  the  dependent  variable.  This  tends  to  improve  the  fit  at  low  values  of 
the  dependent  variable.  The  improvement  in  the  fitting  of  the  Phase  I TOGW  dependent  variable 
using  the  log  transformation  is  shown  in  figure  8.  For  all  cases  where  transformations  are  used,  the 
figures -of-merit  for  the  regression  accuracy  are  based  on  the  error  in  the  un transformed  values  of 
the  dependent  variable.  Comparison  of  these  data  with  the  untransformed  data  shows  that  the 
maximum  percent  error  is  significantly  reduced  and  the  percent  error  for  all  the  data  is  improved. 
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Dependent  Variable:  TOGW  = / (W/S,  BPR,  TR,  SWEEP,  T/W) 


Figure  7.  Distribution  of  &TOGW  for  Conventional  Regression 


Dependent  Variable:  Log  TOGW  = / (W/S,  BPR,  TR,  SWEEP,  T/W) 


of  ATOGW  for  Lag 


Closer  examination  of  the  differential  form  shows  that  a family  of  transformations  can  be 
defined  which  have  different  “weighting”  effects  on  the  error  differences.  In  general,  the 
differential  form  of  the  dependent  variable  can  be  defined  as  Ay  a (A  TOGW)  TOGWN,  where 
N is  defined  in  this  report  as  the  derivative  exponent.  Thus  for  the  log  transformation  N = -1, 
and  the  N for  the  untransformed  case  is,  by  definition,  equal  to  zero.  Figure  9 presents  the  family 
of  transformations  derived  using  TOGW  as  an  example  of  the  dependent  variable.  Note  that  for 
N < 0,  only  dependent  variables  with  values  greater  than  zero  can  be  considered  for 
transformation.  In  practice  this  can  be  overcome  by  adding  a constant  to  all  dependent  variable 
values  to  produce  positive  values. 

The  dramatic  effect  of  using  transformations  of  the  dependent  variable  can  be  seen  in 
figure  10.  In  this  study,  the  selection  of  the  transformation  y = TOGW*1  (i.e.,  the  derivative 
exponent  = -2)  results  in  the  largest  reduction  in  the  maximum  percent  error  (from  30%  to 
11.9%),  while  reducing  the  average  error  as  well.  For  comparison  with  the  two  previous  error 
distribution  curves,  figure  11  shows  the  error  distribution  for  the  inverse  transformation.  Ab 
shown,  the  errors  of  prediction  in  the  region  of  most  interest  (lower  values  of  TOGW)  are,  in 
general,  lower  than  those  of  the  conventional  untransformed  regression  results.  In  addition,  lower 
percent  errors  were  obtained  over  the  entire  range  of  TOGW  values  considered. 

The  generalized  development  of  transformations  does  not  preclude  their  use  for  other 
dependent  variables.  Transformations  have  also  been  used  to  improve  the  regression  accuracy  of 
takeoff  distance  and  combat  acceleration  time.  Figures  12  and  13  show  the  dramatic 
improvement  in  maximum  and  average  percent  errors  of  each  of  these  variables  for  a range  of 
derivative  exponents.  While  transformation  methodology  has  shown  significant  accuracy 
improvement  for  these  variables,  some  variables  such  as  combat  g-loading  and  landing  velocity 
had  excellent  fits  without  transformations  (i.e.,  N = 0).  As  shown,  transformations  of  TOGW 
data  enabled  us  to  substantially  reduce  prediction  error  for  Phase  I data.  However,  the  resulting 
errors  were  still  higher  than  desirable  considering  that  only  five  independent  variables  were  used. 


General  Form:  Aya  (A TOGW)  TOGW1 ' 


Transformation 

Differential  Form 

Derivative 
Exponent,  N 

y - TOGW*  - / (Independent  Variables) 

Ay o (ATOGW)  TOGW 

+1 

y * TOGW  * / (Independent  Variable!) 

Ay o ATOGW 

0 

y - log  (TOGW)  = f (Independent  Variable*) 

(ATOGW) 

Ay“  TOGW 

-1 

y - (TOGW)-»  » f (Independent  Variable*) 

(ATOGW) 

Ay“  TOGW"* 

-1  Vi 

y ” (TOGW)'1  - / (Independent  Variable*) 

(ATOGW) 

Ay“  TOGW* 

-2 

n>  14*447 


Figure  9.  Transformations  of  TOGW 
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Derivative  Exponent,  N of  TOGW 
as  a Dependent  Variable 

FD  14*407 


Figure  10.  Effect  of  Transformations  on  TOGW  as  a Dependent 
Variable 


Figure  12.  Effect  of  Transformations  on  Takeoff  Distance  as  a Figure  13.  Effect  of  Transformations  on  Acceleration  Time  as  a 

Dependent  Variable  Dependent  Variable 


2.  Transformations  — Phasa  II  Data 

a.  RADIUS  as  a Dapandant  Varlabla 

RADIUS  aa  a dependent  variable  presents  several  problems.  First,  not  all  combinations  of 
independent  variables  provide  a positive  dash  radius.  Therefore,  Boeing  Company  conceived  the 
concept  of  negative  dash  radius.  Although  this  is  mathematically  correct,  it  has  no  physical 
meaning.  This  concept  of  negative  dash  radius  provides  a continuous  surface  to  fit  and  provides 
sufficient  data  to  complete  the  data  selection  pattern.  This  concept  was  also  used  previously  in 
the  ARES  study. 

Total  mission  RADIUS  was  regressed  for  RSTEP  in  order  to  apply  the  transformation 
methods  (i.e.,  Radius  > 0),  but  actual  delta  dash  radius  statistics  were  used  for  the  figure-of- 
merit.  The  results  are  shown  in  figure  14.  It  is  not  clear  from  these  results  that  regressing  RADIUS 
is  more  accurate  than  regressing  TOGW  as  was  done  with  the  Phase  I data.  This  comparison  will 
be  addressed  further  in  the  following  section. 

b.  Quadratic  Solution 

A method  for  evaluating  the  regression  accuracy  of  RADIUS  as  a dependent  variable  can  be 
obtained  by  observing  that  the  regression  equation  form  used  is  quadratic  and  that  an  exact 
closed  form  solution  exists  for  any  one  of  the  independent  variables  in  terms  of  the  other 
variables. 

RADIUS*  = / (TOGW, ) { Quadratic  Equation 

TOGW  * ~b  .i**1  ~ { Quadratic  Solution 

NOTE:  *May  be  transformed  function. 

Hence,  TOGW  can  be  obtained  by  Quadratic  solution  of  the  regression  equation  for 
RADIUS.  Observed  values  for  RADIUS  can  be  substituted  into  this  equation  and  TOGW 
calculated  and  compared  with  known  values.  This  method  also  has  the  advantage  of  being  able 
to  solve  the  problem  of  determining  minimum  TOGW  for  a given  Radius  requirement. 

Combining  the  Transformation  and  Quadratic  solution  methodologies  we  find  in  figure  15 
that  the  best  transformation  provides  a maximum  error  of  11.8%  and  a 3.4%  average  percent 
error.  Note  that  this  error  is  similar  to  the  11.9%  max  percent  error  and  3.6%  average  error  result 
from  the  Phase  I data. 
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Figure  14.  Effect  of  Transformations  on  RADIUS  as  a Depen - Figure  IS.  Effect  of  Transformations  on  TOGW  Calculated  by 

dent  Variable  as  a Function  of  Five  Variables  Quadratic  Solution  of  RADIUS  as  a Function  of  Five 

Variables 


B.  ROLE  REVERSAL  METHODOLOGY 
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An  alternative  method  for  using  the  Phase  II  data  base  is  to  apply  a method  defined  in  this 
report  as  Role  Reversal.  The  Phase  II  data  set  chosen  for  study  uses  TOGW  as  a mission  input 
(independent  variable)  with  RADIUS  as  an  output  (dependent  variable)  of  the  mission 
calculation.  The  traditional  approach  is  to  regress  RADIUS  (dependent  variable)  as  a function  of 
TOGW  and  the  other  independent  variables.  This  approach  would  address  the  question  of 
predicting  RADIUS  for  a given  TOGW.  A problem  of  greater  interest  is  to  predict  TOGW  for  a 
given  RADIUS.  For  this  problem  it  would  be  more  convenient  to  use  TOGW  as  the  dependent 
variable  and  RADIUS  as  the  independent  variable.  Thus,  the  Role  Reversal  methodology  is  to 
reverse  the  roles  of  these  two  variables,  and  regress  TOGW  as  a function  of  RADIUS,  W/S,  BPR, 

TR,  etc Comparison  of  regressed  values  of  TOGW  with  the  hard  point  data  input  to  the 

mission  simulation  becomes  the  figure-of-merit.  The  Role  Reversal  methodology  combined  with 
transformation  methods  described  previously  has  proved  to  be  effective  in  improving  TOGW 
regression  accuracy. 

The  improvement  in  regression  accuracy  using  the  Role  Reversal  technique  for  TOGW  as 
compared  to  the  quadratic  solution  for  TOGW  from  Radius  regressions  is  shown  in  figure  16. 
Transformations  combined  with  Role  Reversal  methodology  reduce  the  maximum  percent  error 
from  12%  to  7%  and  reduces  the  average  percent  error  from  3.5%  to  2%.  Observe  that  the  most 
effective  transformation  for  Role  Reversal  combined  with  Transformation  methodologies  is  the 
log  (TOGW).  This  differs  from  the  reciprocal  transformation  shown  to  be  the  best  for  the  Phase 
I data. 

An  interesting  side  result  of  using  Role  Reversal  occurs  when  the  quadratic  solution  is 
applied  to  the  TOGW  regression  equation  (in  which  Role  Reversal  was  used),  and  RADIUS  is 
calculated.  This  result  is  shown  in  figure  17  along  with  the  result  for  direct  regression  of  RADIUS. 
The  RADIUS  prediction  by  Role  Reversal  and  Quadratic  solution  is  significantly  more  accurate 
than  direct  RADIUS  regression.  The  implication  here  is  that  the  TOGW  surface  can  be  regressed 
more  accurately  than  the  RADIUS  surface. 

A summary  of  the  accuracy  improvements  provided  by  the  Transformation  and  Role 
Reversal  Methodologies  is  presented  in  figure  18.  Case  A,  the  un transformed  baseline,  had  a very 
large  maximum  error  of  33.6%.  Case  B is  the  result  of  applying  the  best  TOGW  transformation. 
It  yielded  a reduction  in  maximum  error  from  33.6%  to  11.9%,  and  a reduction  in  average  absolute 
error  from  5.8%  to  3.6%.  A shift  to  Phase  II  data  which  had  TOGW  as  an  independent  variable 
permitted  application  of  Role  Reversal  methodology.  Case  C represents  the  best  radius 
transformation  regression,  with  TOGW  being  calculated  by  quadratic  solution.  This  yields 
results  very  similar  to  the  Phase  I transformed  data.  Case  D has  Role  Reversal  applied,  and 
further  improvement  in  accuracy  is  achieved. 

C.  INDIRECT  METHODOLOGY 
1.  Discussion  of  Methodology 

Another  approach  studied  as  part  of  this  contract  utilizes  physically  derived  relationships 
in  an  effort  to  improve  regression  accuracy.  Variables  such  as  fuel  fraction,  propulsion  fraction, 
engine  diameter,  and  engine  length  are  used  as  independent  variables  in  the  regression  of 
RADIUS,  TOGW,  etc.  The  method  is  termed  indirect  because  the  physically  derived  variables 
are  first  regressed  in  terms  of  the  basic  5 through  10  design  variables.  Then,  the  equations  of  these 
variables  are  used  to  supply  input  for  calculating  dependent  variables  such  as  TOGW  from  a 
regression  equation  containing  the  physically  derived  variables. 
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Derivative  Exponent,  N 


Figure  16.  Effect  of  Role  Reversal  on  Regressed  Values  of  TOGW  as  a Function  of  Five  Variables 
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5 Variable  - Full  Replication  Results  .Transformations  of 
TOGW  and  RADIUS  = / (BPR.  TR.  T/W.  W/S.  TOGW  or  RADIUS) 


Regressed  Range 
Quadratic  Solution 
For  RADIUS  From 
TOGW  Regression 


. — o— 


Derivative  Exponent,  N 


Max  Error 


Average  Error 


Figure  17.  Companion  of  RADIUS  Errors  — Regretted  Range  vt  Quadratic 
Solution  for  Range  from  a Five  Variable  Regrettion  of  TOGW 
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Figure  18.  Impact  of  Transformation  and  Role  Reversal  Methodologies  on 
Regression  Accuracy  — Five  Variable  Regression 


This  method  has  not  been  shown  to  provide  significantly  better  regression  accuracy 
compared  to  more  direct  methods  even  when  Transformation  and  Role  Reversal  methodologies 
are  applied. 


2.  Phase  I Data  Results 


The  approach  taken  is  based  on  the  characteristic  relationship  of  TOGW  as  a function  of 
propulsion  plus  fuel  weight  fractions  instead  of  engine  cycle  variables.  The  propulsion  and  fuel 
weight  fractions  can  be  regressed  separately  as  a function  of  the  engine  cycle  and  aircraft 
variables. 

Results  for  indirect  regression  of  TOGW  for  the  5 variable  case  are  presented  in  figure  19  to 
illustrate  the  methodology.  As  shown,  the  histogram  is  divided  into  the  best  results  for  Phase  I 
data  using  direct  regression  of  TOGW  (IA)  and  two  indirect  regressions  of  TOGW.  The  result 
represented  by  IB  utilizes  the  sum  of  fuel  and  propulsion  fractions  and  engine  length  and 
diameter  as  independent  variables  (in  addition  to  W/S  and  SWEEP)  as  shown  below: 

TOGW'1  = / ( ^fU*‘  TOC)w'PUl“°'1  ~ ’ Diaraeter-  Length,  W/S,  Sweep) 

Regressed  values  for  the  physically  derived  variables,  Wfu„  + WpropU|,|0n/TOGW,  engine 
diameter,  and  engine  length  (obtained  from  the  best  transformation  fits)  are  substituted  into  a 
regression  equation  for  TOGW  obtained  by  fitting  only  observed  values  for  the  basic  and 
physically  derived  variables  in  order  to  determine  the  error  in  predicting  TOGW.  As  shown  in 
figure  V-13,  the  approach  represented  by  IB  results  in  maximum  and  average  absolute  percent 
errors  considerably  greater  than  the  direct  approach  IA. 
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Regress  TOGW*1  « / (BPR,  TR,  T/W, 
W/S,  SWEEP) 


Regress  TOGW  * /■)  ( 
D,  L,  W/S,  SWEEP) 


wFuel  + ^Propulsion 
TOGW 


Regress  WE^1^^3PUltiQn  . /2  (bpr,  TR, 
T/W,  W/S,  SWEEP) 


Substitute  © into  © 


Regress  TOGW  [ 1-Wpwl  ^gpul?l-on  ] 


Regress 


wFuel  + ^Propulsion 
TOGW 


f2  (BPR,  TR. 


T/W,  W/S,  SWEEP) 


Substitute  © into  © 


ethods 


10  15  20  25 

Percent  Error 


future  19.  Summary  of  Indirect  Methods  for  Phan  I Data 
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The  second  approach  to  the  indirect  method,  IC,  utilizes  the  physically  derived 
relationships  in  the  dependent  variable  rather  than  as  an  independent  variable  as  shown  below: 


r 


f (W/S,  BPR,  TR,  T/W,  SWEEP) 

of  fuel  plus  propulsion  fraction  were  used. 

Very  good  accuracy  (maximum  error  ~ 1.5%)  was  obtained  for  the  regression  of  fuel  plus 
propulsion  fraction  as  a function  of  the  basic,  five  independent  variables  (BPR,  TR,  W/S,  T/W, 
SWEEP).  The  good  fit  indicates  that  the  fuel  plus  propulsion  fraction  is  a fundamental 
parameter.  However,  regression  of  the  function 

TOGW  ( 1 - WfU,1TOGWPUl,l°"~) 

resulted  in  about  10%  maximum  error , yielding  a combined  error  of  12%  for  TOGW, as  shown  in 
figure  19.  These  results  show  that  the  indirect  methods  utilizing  physically  derived  relationships 
yield  regression  accuracies  about  the  same  as  direct  regression.  However,  the  possibility  remains 
that  another  variation  of  Indirect  methods  could  provide  improvement. 

3.  Phase  II  Data  Results 

The  approach  taken  with  the  Phase  II  data  with  Radius  as  a variable  was  to  regress  TOGW 
as  a function  of  some  form  of  fuel  fraction  (Wfu.i/TOGW)  rather  than  RADIUS  as  an  independent 
variable.  Once  a regression  equation  for  TOGW  is  obtained,  then  the  second  step  is  to  regress  the 
form  of  fuel  fraction  as  a function  of  RADIUS  (and  BPR,  TR,  T/W,  and  W/S  for  a five  variable 
case).  The  third  step  is  to  calculate  values  for  the  appropriate  form  of  fuel  fraction  from  step  two 
and  substitute  them  into  the  step  one  equation  for  TOGW. 

The  first  attempt  at  this  process  quickly  yielded  promising  results.  By  regressing  the 
following  equation: 

TOGW-'  = ( , BPR,  TR,  T/W,  W/s)  , 


TOGW  (l  - 


wfu.,  + w, 


propulsion 


TOGW 

for  determining  the  TOGW  error,  regressed  value 


it  was  found  that  the  maximum  percent  error  in  TOGW  was  only  0.9%.  Three  other  variations  in 
the  form  of  fuel  fraction  were  also  tried  in  order  to  further  improve  this  result. 

Results  of  regression  analysis  of  TOGW  using  these  variations  are  shown  in  figure  20.  This 
figure  summarizes  the  Phase  H indirect  methods  results,  and  compares  the  results  with  direct 
regression  of  TOGW,  method  HA.  (The  steps  required  to  solve  for  TOGW  are  shown)  for  each 
method  presented.  The  first  results  are  shown  as  method  IIB.  As  shown,  the  error  in  magnitude 
of  3.0%  of  fuel  fraction  is  not  good  enough  because  TOGW  is  very  sensitive  to  fuel  fraction. 
Method  IIC  produced  an  improvement  in  fuel  fraction  prediction  by  applying  a TOGW  correction 
factor  to  the  fuel  fraction  to  account  for  size  effects  on  the  aircraft  drag.  The  coefficient,  0.15,  was 
obtained  by  parametric  optimization.  Overall  results  for  IIC  show  no  overall  improvement  over 
indirect  method  IIB.  Method  IID  is  another  variation  on  fuel  fraction  form.  The  log  form  used  for 
the  fuel  fraction  was  derived  from  the  Breguet  range  equation.  The  overall  effect  of  IID  produced 
a small  improvement  in  accuracy  over  IIC,  but  still  not  as  good  as  IIB. 
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Regress  TOGW'1  = /,  (Log(  -w~)  [ 1 - 0.2  4^]  ) 

1 TOGW 
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Substitute  2 Into  1 
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Figure  20.  Summary  of  Indirect  Methods  for  Phase  n Data 
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Of  all  the  methods  examined,  method  DG  offers  the  best  accuracy  of  the  indirect  methods, 
but  it  is  only  marginally  better  than  the  direct  method,  HA.  Note  that  the  indirect  methods  that 
incorporate  TOGW  correction  factor  (ATOGW/TOGW)  to  the  fuel  fraction  (such  as  DG)  are 
actually  transcendental  and  the  solution  presented  is  based  upon  the  first  estimate  for  TOGW  in 
the  correction  term  being  equal  to  the  observed  value  of  TOGW.  The  approximation  is  reasonable 
since  the  term  represents  a small  correction  to  the  fuel  fraction.  A rigorous  solution  would  require 
an  iterative  procedure.  It  is  probably  doubtful  that  the  small  improvement  offered  by  the  best 
indirect  method  over  the  direct  regression  is  worth  the  added  complication  in  the  calculating 
procedure. 

D.  OPTIMIZED  POLYNOMIAL  EXPONENT  METHODOLOGY 

The  Optimized  Polynomial  Exponent  method  is  designed  to  improve  the  surface  fits  by 
determining  the  best  form  and  order  of  the  combined  polynomial  and  cross  product  regression 
equation  terms.  A computerized  program  was  assembled  from  existing  subroutines  to  determine 
the  exponents  of  each  of  the  elements  of  the  terms  of  a generalized  regression  equation  by  a 
stochastic  search  and  optimization  process;  and,  to  determine  the  coefficients  of  these  terms  in 
the  resulting  equation,  by  a least  squares  regression  method. 

The  generalized  form  of  the  equation  used  (for  a 5-variable  problem)  is  shown  in  Figure  21. 
By  inspection,  the  equation  is  capable  of  producing  multiple  order  polynomial  and  triple  cross 
product  terms  with  non-integer  exponents.  The  exponents  and  coefficients  of  the  terms  of  the 
generalized  equation  are  calculated  in  the  fashion  shown  in  the  schematic,  figure  22.  The 
computerized  method  is  started  by  selecting  values  for  each  of  the  exponents  in  the  generalized 
regression  equation  in  a random  manner  from  within  a range  of  exponents  having  both  upper  and 
lower  bounds  (e.g.-2^n^2).  When  specific  exponents  are  applied,  the  equation  formed  is  termed 
a specific  regression  equation.  The  next  step  in  the  computerized  method  is  a standard  least 
squares  regression  of  the  dependent  variable  in  terms  of  the  defined  specific  regression  equation. 
A single  figure-of-merit  characterising  the  performance  of  the  regression  is  identified  by  the  user. 
Examples  of  types  of  figures-of-merit  are:  Maximum  percent  error,  standard  error  of  estimate, 
max  delta,  etc.  The  procedure  selects  a group  of  50  (input  variable)  specific  regression  equations, 
each  of  which  has  randomly  chosen  exponents.  The  figure-of-merit  is  used  within  the  CROP 
stochastic  search  module  to  first  narrow  the  limits  or  bounds  of  potential  exponents  and  then  to 
stochastically  select  the  next  50  sets  of  exponents  for  the  generalized  regression  equation.  The 
iteration  is  continued  until  the  best  set  of  exponents  within  the  original  range  is  selected  to  yield 
the  best  figure-of-merit  resulting  in  a complete  regression  equation  for  the  dependent  variable  of 
interest. 

The  CROP  (Cluster  Recognition  Optimization  Program)  module  is  a P&WA  developed 
program  used  previously  on  a wide  variety  of  multi-variable  optimization  problems.  It  uses  an 
accelerated  stochastic  search  technique  designed  to  select  combinations  of  parameters  that 
improve  a prescribed  figure-of-merit  using  multiple  cluster  recognition  logic.  In  CROP,  the 
parameters  selected  at  random  are  the  exponents;  and,  successive  iterations  result  in  a narrowing 
of  the  search  bounds  of  the  exponents  in  order  to  group  together,  or  cluster,  potential  solutions  to 
speed  up  convergence  on  the  best  set  of  exponents.  This  particular  routine  is  capable  of 
recognizing  multiple  sets  of  exponents  (i.e.,  multiple  clusters)  that  are  valid. 

This  method  was  applied  to  the  Phase  II  data  only.  A summary  of  the  analysis  results  are 
presented  in  tables  7 and  9 for  a variety  of  equation  forms  and  replication  patterns  for  the  five 
variable  data  set.  The  method  is  considered  to  be  rather  expensive  considering  that  2 million 
potential  exponents  are  evaluated  during  a typical  analysis.  Therefore,  its  use  was  limited  in  this 
study  to  very  selective  cases  and  only  to  problems  of  fitting  TOGW. 
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Generalized  form  of  the  regression  equation  for  the  Optimized  Polynomial  Exponent 
Method 

/ = So  + ajXMl  + a^tM‘  + aptMI  + a,xM4  + a*x***  + a#xM* 

+ aTx“’  + a*xM*  + a*!*4'  + a10x“10 
+ a„xM»  x*“*  x**“  + a,,!*14  x““  x*“4 
+ ai»xMlT  xM“  x*“  + aux*4*0  x““  x"“ 

+ a„xMM  x*4*4  xM,‘  + aux*4*4  xMr  x““ 

+ a,txMf4  xM"  x*4*1  + auxMM  xMU  xM“ 

+ attxM,t  x“M  x*444  + a^x*4**  xMM  x*440 

It)  146400 

Figure  21.  Generalized  Form  of  the  Regression  Equation  for  the  Optimized 
Polynomial  Exponent  Method 


‘Cluster  Recognition  Optimization  Program  (CROP) 


Ft)  146430 

Figure  22.  Cluster  Recognition  Optimization  Program  (CROP) 
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Table  7.  Effect  of  Optimums  Exponents  upon  TOGW,  Full  Replication. 


Fit  Deck 

Optimised  Polynomial  Exponent  Deck 

Fix  Single 
Term  Exponents; 
Fix  Double 
Cross-Product 
Exponents 

Fix  Single 
Term  Exponents; 
Vary  Double 
Cross-Product 
Exponents 

Vary  Single 
Term  Exponents; 
Vary  Double 
Cross-Product 
Exponents 

Fix  Single 
Term  Exponents; 
Vary  Triple 
Cross-Product 
Exponents 

Mss  % Error 

7.03 

6.87 

6.80 

6.26 

Avntfi  IMU 

1266 

1334 

1679 

1366 

SEE 

2346 

2400 

2799 

2436 

Avmp,  % 

2.00 

2.06 

2.60 

2.13 

PEE 

3.62 

3.48 

4.61 

3.61 

Derivative  Exponent,  N 

-1 

-1 

-1 

-1 

Table  8.  Effect  of  Optimising  Exponents  upon  TOGW,  Full  vs  Half  Replication 
Comparison  S Variable  TOGW  Fit.  Fit  Single  Term  Exponents;  Vary 
Triple  Cross-Product  Exponents 


Replication 

Full 

Augmented 

Half 

No.  of  Point*  Fit 

43 

27+1 

27+1 

Total  Point*  Checked 

43 

27+1 

43 

Max  % Error 

6.26 

4.66 

9.64 

Average  Delta 

1366 

1363 

1666 

SEE 

2436 

3166 

2760 

Average,  % 

2.13 

2.17 

2.36 

PEE 

3.61 

4.76 

4.91 

Derivative  Exponent,  N 

-1 

-1 

-1 

Table  7 is  divided  into  two  sections.  Results  for  the  best  solution  obtained  using 
Transformations  and  Role-Reversal  methodologies  in  a standard  least  squares  regression  fit  of  a 
second  order  polynomial  form,  are  listed  under  the  “fit”  deck  heading.  For  the  three  examples  of 
Optimized  Polynomial  Exponent  method  shown,  the  figure-of-merit  selected  was  maximum 
percent  error.  In  each  of  these  cases  the  maximum  percent  error  was  reduced  when  compared  with 
the  base  line  case,  but  increases  in  other  statistics  are  apparent.  As  can  be  seen,  the  optimized 
polynomial  method  only  reduced  the  max  % error  from  7%  to  about  6%,  and  produced  no 
improvement  in  the  SEE  or  average  percent  error. 


SECTION  V 

PRESENTATION  OF  REGRESSION  RESULTS 


A.  INTRODUCTION 

The  objectives  of  the  Regression  Simulation  of  Turbine  Engine  Performance  (RSTEP)  Task 
IV  study  include  investigating  the  number  of  variables  (5  through  10)  and  the  number  of  data 
points  required  to  provide  sufficient  confidence  in  the  regression  statistics  accuracy.  In  each  of 
the  surface  fits  studied,  a consistent  group  of  statistics  describing  the  regression  were  compared. 
Since  most  of  these  statistics  are  common  to  regression  analysis,  familiarity  with  their  definitions 
is  assumed  in  this  report.  Two  statistics  not  well  defined  are  average  percent  error  and  percent 
error  of  estimate  (PEE).  Average  percent  error  is  defined  in  this  report  to  be  the  average  of  the 
absolute  values  of  percent  error.  The  PEE  statistic  is  analogous  to  the  standard  error  of  estimate 
and  is  defined  as  the  deviation  of  the  percent  error  about  the  average  percent  error. 

In  addition  to  examining  the  statistics  of  the  regressed  data  statistics  of  additional  data 
termed  “check  points,”  were  also  examined  for  each  surface  fit.  Check  points  are  defined  as  data 
points,  excluded  from  the  regression  data  set,  that  are  available  for  inspection.  One  source  of 
these  check  points  are  data  points  left  over  when  half  (or  quarter)  replication  of  a variable  is 
studied,  but  full  (or  half)  replication  data  are  available.  A progressively  larger  source  of  check 
points  is  also  available  for  increasing  numbers  of  variable  cases  where  points  not  normally 
calculated  for  a given  number  of  variables  to  be  regressed  are  at  hand  because  the  study  includes 
a buildup  in  the  number  of  variables  regressed.  This  data  is  termed  check  data  because  values  of 
independent  variables  for  each  check  point  are  substituted  into  the  regression  equation  to 
determine  the  value  of  the  dependent  variable  for  each  check  point.  The  value  of  the  calculated 
dependent  variable  can  then  be  compared  or  checked  with  the  appropriate  check  data.  Statistics 
for  the  combined  regressed  and  check  data  can  be  calculated  for  comparisons.  Examination  of 
both  regressed  and  check  data  has  proved  to  be  the  only  way  to  properly  assess  the  surface  fit 
accuracy. 

The  results  present  Phase  II  data  only.  The  presentation  is  divided  by  parameters.  The 
parameters  investigated  were:  take-off  gross  weight  (TOGW),  take-off  distance,  combat 
acceleration  time,  combat  g-load,  and  landing  velocity.  For  each  parameter  the  presentation  is 
further  broken  down  into  five  through  ten  variables  for  the  range  of  replications  studied.  In 
general,  the  data  presented  represents  the  best  results  after  application  of  Transformation  and 
Role  Reversal  methodologies.  For  each  surface  fit,  a table  of  characteristic  statistics  is  presented; 
and,  for  TOGW,  plots  of  the  error  distribution  are  presented.  Each  table,  in  general,  includes  the 
statistics  for  the  regressed  data  and  the  cumulative  statistics  for  regressed  and  check  data  (where 
available).  The  error  distribution  plots  also  present  both  regressed  and  check  data.  The  shaded 
error  distribution  represents  the  regressed  data  results,  while  the  cumulative  results  are  presented 
in  outline. 

B.  TOGW  REGRESSION  RESULTS 

Of  the  five  parameters  studied,  TOGW  proved  to  be  the  most  difficult  to  obtain  good 
regreesion  accuracy.  The  reeults  are  presented  in  Tables  9 through  20,  and  Figures  23  through  34. 

Plocuoslon  of  TOGW  Ragroeaion  Accuracy 

Table  21  preeenta  replication  patterns  studied  for  each  of  the  numbers  of  variables 
considered. In  general,  reeults  from  the  study  show  that  for  the  five,  six,  seven,  eight  and  nine 
independent  variables,  half  replication  is  sufficient  to  accurately  predict  a regression  surface.  For 
the  ten  variable  level,  only  the  quarter  replication  pattern  was  studied,  but  the  regression 
surfaces  accuracy  and  error  distribution  indicate  that  quarter  replication  is  acceptable  for  ten 
variables. 
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Table  9.  Takeoff  Gross  Weight  — 5 Variable 
Regression,  Full  Replication 


1 


No.  of  Points  Fit 

Total  Points  Checked 

Max  % Error 

Average  Delta 

SEE 

Average,  % 

PEE 

R* 

Derivative  Exponent,  N 

43 

43 

7.03 

1266 

2346 

2.00 

3.62 

0.9932 

-1 

Table  10.  Takeoff  Gross  Weight  — 5 
Regression,  Half  Replication 

Variable 

No.  of  Points  Fit 

27 

27 

(27  + 1) 

Total  Points  Checked 

27 

43 

43 

Max  % Error 

6.76 

13.77 

6.86 

Average  Delta 

731 

1466 

1448 

SEE 

2022 

2363 

2609 

Average,  % 

1.27 

2.37 

2.34 

PEE 

3.84 

4.89 

4.06 

R* 

0.9968 

— 

— 

Derivative  Exponent,  N 

-1 

— 

— 

Table  11.  Takeoff  Gross  Weight  — 6 Variable 
Regression,  Full  Replication 

No.  of  Points  Fit 

77 

77 

Total  Points  Checked 

77 

87 

Max  % Error 

8.79 

11.26 

Average  Delta 

1400 

1624 

SEE 

2444 

2640 

Average,  % 

2.26 

2.63 

PEE 

3.71 

4.13 

R’ 

0.9914 

— 

Derivative  Exponent,  N 

-1 

— 

Table  12.  Takeoff  Gross  Weight  — 6 Variable 
Regression,  Half  Replication 

No.  of  Points  Fit 

46 

46 

Total  Points  Checked 

46 

87 

Max  % Error 

8.66 

9.90 

Average  Delta 

1104 

1463 

SEE 

2471 

2647 

Average,  % 

1.87 

2.41 

PEE 

4.22 

4.02 

R* 

0.9926 

— 

Derivative  Exponent,  N 

-1 

— 

Table  13.  Takeoff  Gross  Weight  — 7 Variable 
Regression,  Full  Replication 


No.  of  Point*  Fit 

143 

143 

Totel  Point*  Checked 

143 

166 

Mu  % Error 

8.61 

8.83 

Average  Delta 

1616 

1622 

SEE 

2361 

2448 

Average,  % 

2.46 

2.66 

PEE 

3.66 

3.84 

R* 

0.9611 

— 

Derivative  Exponent,  N 

-1 

— 

Table  14.  Takeoff  Gross  Weight  — 7 Variable 
Regression,  Half  Replication 

No.  of  Pointe  Fit 

79 

79 

Total  Point*  Checked 

79 

166 

Mu  % Error 

8.42 

9.36 

Average  Delta 

1477 

1686 

SEE 

2647 

2461 

Average,  % 

2.40 

2.57 

PEE 

4.11 

3.72 

R* 

0.9608 

— 

Derivative  Exponent,  N 

-1 

— 

Table  IS.  Takeoff  Gross  Weight  — 8 Variable 
Regression,  Full  Replication 


No.  of  Pointe  Fit 

273 

273 

Total  Pointe  Checked 

273 

306 

Mu  % Error 

13.14 

13.86 

Average  Delta 

1916 

2027 

SEE 

2813 

2926 

Average,  % 

3.13 

3.33 

PEE 

4.33 

4.68 

R* 

0.9861 

— 

Derivative  Exponent,  N 

-1 

— 

Table  16.  Takeoff  Gross  Weight  — 8 Variable 
Regression,  Half  Replication 


No.  of  Pointe  Fit 

146 

146 

146 

Total  Pointe  Checked 

146 

278 

306  | 

Mu  % Error 

12.60 

12.60 

12.90 

Average  Delta 

1946 

1929 

2037 

SEE 

3164 

2829 

2932 

Average,  % 

3.18 

3.18 

3.37 

PEE 

4.86 

4.40 

4.63 

R* 

0.9848 

— 

Derivative  Exponent,  N 

-1 

— 

j 
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Table  17.  Takeoff  Grose  Weight  — 8 Variable 
Regression,  Quarter  Replication 


I 

■V 


No.  of  Potato  Fit 

Total  Potato  Checked 

Mu  % Error 

Average  Delta 

SEE 

Average,  % 

PEE 

R* 

Derivative  Exponent,  N 

SI  81 

81  273 

8.74  94.42 

9.69  9472.81 

1938  16619.00 

1.68  17.23 

3.04  33.88 

0.9969  - 

0 — 

81 

309 

94.42 

8842.66 

16492.00 

16.68 

31.64 

Table  18.  Takeoff  Gross  Weight  — 9 
Regression,  Half  Replication 

Variable 

No.  of  Potato  Fit 

276 

276 

276 

Total  Potato  Checked 

276 

403 

466 

Mu  % Error 

17.79 

17.79 

17.79 

Average  Delta 

2122 

2066 

2168 

SEE 

3196 

2993 

3076 

Average,  % 

3.47 

3.38 

3.67 

PEE 

4.96 

4.66 

4.86 

R* 

0.9820 

— 

— 

Derivative  Exponent,  N 

-1 

— 

— 

Table  19.  Takeoff  Gross 

Weight 

- 9 

Variable 

Regression,  Quarter  Replication 

No.  of  Potato  Fit 

147 

147 

147 

Total  Potato  Checked 

147 

403 

466 

Mu  % Error 

14.07 

36.13 

36.13 

Average  Delta 

1927 

4062 

3962 

SEE 

3368 

6629 

6266 

Average,  % 

3.23 

6.63 

6.37 

PEE 

6.39 

9.66 

9.24 

R* 

0.9827 

— 

— 

Derivative  Exponent,  N 

-1 

— 

— 

Table  20.  Takeoff  Gross  Weight 

- 10 

Variable 

Regression,  Quarter  Replication 

No.  of  Potato  Fit 

277 

277 

277 

Total  Potato  Checked 

277 

633 

603 

Mu  % Error 

17.13 

17.13 

17.13 

Average  Delta 

1899 

2141 

2196 

SEE 

2986 

3106 

3117 

Average,  % 

3.16 

3.67 

3.67 

PEE 

4.74 

4.96 

6.02 

R* 

0.9844 

— 

— 

Derivative  Exponent,  N 

-1 

— 

— 
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Figure  23.  TOGW  Error  Distribution  — Log 
Transformation  6 Variables,  Full 
Replication 
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Figure  26.  TOGW  Error  Distribution  — Log 
Transformation  6 Variables,  Full 
Replication 
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Figure  24.  TOGW  Error  Distribution  — Log 
Transformation  B Variables,  Half 
Replication 
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Figure  26.  TOGW  Error  Distribution  — Log 
Transformation  6 Variables,  Half 
Replication 
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Figure  27.  TOGW  Error  Distribution  — Log 
Transformation  7 Variables,  Full 
Replication 


Figure  28.  TOGW  Error  Distribution  — Log 
Transformation  7 Variables,  Half 
Replication 
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Figure  30.  TOGW  Error  Distribution  — Log 
Transformation  8 Variables,  Half 
Replication 
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Figure  29.  TOGW  Error  Distribution  — Log 
Transformation  8 Variables,  Full 
Replication 
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Figure  31.  TOGW  Error  Distribution  — Log 
Transformation  8 Variables,  Quarter 
Replication 
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Figure  32.  TOG  IV  Error  Distribution  — Log 
Transformation  9 Variables,  Half 
Replication 


0 Check  Data 
Q Ragreaaed  Data ' 


0 4 8 12  18  20  24 

Per  Cent  Error 


32  38  40 


Figure  33.  TOGW  Error  Distribution  — Log  Figure  34.  TOGW  Error  Distribution  — Log 
Transformation  9 Variables,  Quarter  Transformation  10  Variables,  Quar- 

RepUcation  40  ter  Replication 
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Table  21.  TOGW  Replication  Patterns  Stud- 
ied 


Number  of 
Variables  Regressed 

5 

6 

7 

8 

9 10 

Full  Replication 

X 

X 

X 

X 

Half  Replication 

X 

X 

X 

X 

X 

Quarter  Replication 

X 

X X 

Specifically  for  the  TOGW  5- variable  case,  statistics  for  the  half  replication  regression  show 
an  improvement  over  the  full  replication  if  only  the  regressed  data  is  considered.  The  accuracy  of 
the  surface  fit  is  comparable  to  the  full  replication  case  for  all  statistics  except  maximum  percent 
error,  which  increased  from  6.8%  to  13.8%.  Addition  of  the  single  check  point  that  yielded  the  14% 
error  into  the  regression  data  set  resulted  in  a dramatic  reduction  in  the  maximum  percent  error. 
Comparison  of  this  half  replication  result,  including  assessing  check  points,  with  the  full 
replication  results  shows  that  the  surface  fit  accuracy  is  very  similar. 

Results  for  the  six,  seven,  and  eight  variable  comparison  of  full  vs  half  replication  show  that 
half  replication  is  well  behaved.  In  these  cases,  half  replication  of  the  regressed  data  results  in 
regression  statistics  very  similar  in  level  to  those  obtained  for  five  variables.  Note  from  the  error 
distribution  plots  that  the  majority  of  errors  are  low,  as  indicated  by  the  average  error  less  than 
2.5%. 

Regression  of  eight  variables  was  the  first  opportunity  to  examine  quarter  replication. 
Examination  of  the  full  and  half  replication  regression  statistics  for  both  regressed  and  check  data 
shows  comparable  accuracy. 

The  value  of  addressing  check  point  data  is  apparent  for  the  quarter  replication  of  eight 
variables.  The  statistics  of  the  regressed  data  shows  considerable  improvement  over  the  full  and 
half  replication  results.  But,  the  error  distribution  chart  shows  how  non-representative  the 
surface  fit  is  of  the  entire  actual  surface,  as  described  by  all  available  data.  This  indicates  that 
quarter  replication  of  eight  variables  does  not  provide  sufficient  data  to  prevent  confounding  the 
influence  of  the  variable  interactions. 

Nine-variable  half  replication  results  are  similar  to  those  obtained  for  the  8-variable  half 
replication  with  the  exception  of  maximum  percent  error  which  is  higher.  Inspection  of  the 
cumulative  regressed  and  check  data  statistics  shows  that  9-variable  quarter  replication  pattern 
does  not  include  sufficient  data  points  to  describe  the  surface.  The  quarter  replication  error 
distribution  is  improved  relative  to  the  comparable  8-variable  data,  but  quarter  replication  of 
nine  variables  is  not  sufficiently  accurate. 

Ten  variable  quarter  replication  results  show  a slight  improvement  in  statistical  accuracy 
when  compared  with  the  9-variable  half  replication  regression  results,  although  the  maximum 
percent  error  is  still  on  the  order  of  17%.  The  error  distribution  chart  shows  the  regressed  data  to 
be  well  behaved,  which  indicates  that  quarter  replication  of  ten  variables  provides  sufficient  data 
to  define  the  surface.  Results  for  8-  and  9-variable  half  replication  and  the  10-variable  quarter 
replication  are  considered  to  be  statistically  similar. 

A summary  of  results  for  the  minimum  replications  of  each  variable  is  presented  in 
figure  35.  The  chart  shows  that  two  levels  of  accuracy  can  be  identified  as  a function  of  the 
number  of  variables  considered.  At  the  5-,  6-,  and  7-variable  levels  the  level  of  accuracy  is  on  the 
order  of  8%  maximum  percent  error  with  an  excellent  2 to  2.5%  average  error.  For  the  8-,  9-  and 
10-variable  level  where  variables  of  less  influence,  such  as  OPR,  A8  and  AR  were  considered,  the 
maximum  errors  increase  to  approximately  17%  while  the  average  percent  error  rose  only  slightly 
to  approximately  3%.  Closer  examination  of  the  high  error  points  show  that  only  three  data  points 
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(which  represent  extreme  combinations  of  independent  variables)  result  in  the  high  maximum 
percent  errors.  If  these  same  three  data  points  are  eliminated  from  consideration  for  the  9-  and 
10-variable  cases,  the  maximum  percent  errors  drop  dramatically  to  the  8-variable  level.  Note 
then  that  there  are  two  distinct  levels  of  accuracy,  one  at  8%  maximum  error  and  one  at 
13%  maximum  error.  One  possible  conclusion  is  that  the  first  seven  variables  selected 
sufficiently  for  study  are  the  strongest  aircraft/propulsion  system  drivers  and  that  increasing 
numbers  of  variables  introduces  “noise”  into  the  analysis. 
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Figure  36.  TOGW  Check  Data  Comparison  Summary 

The  lesser  significance  of  the  variables  A8,  OPR,  and  AR  is  indicated  by  two  methods  of 
determining  the  conditioning  of  the  normal  equation  matrix  in  the  least  squares  procedure. 
Roeanoff  and  Ginsburg  (Ref.  5)  have  shown  that  the  condition  of  matrix  can  be  determined  by 
comparing  the  ratio  of  extreme  eigenvalues  of  a matrix.  Further,  the  logarithm  to  the  base  ten  of 
this  ratio  is  an  estimate  of  the  maximum  number  of  significant  figures  lost  in  the  inversion  or 
solution  of  the  normal  equations.  Examination  of  the  RSTEP  Task  IV  data  shows  that  the  8-, 
9-,  and  10-variable  cases  definitely  lose  at  least  one  more  significant  digit  in  the  calculation 
process  than  the  5-  and  6-variable  cases. 

Another  measure  of  matrix  conditioning  is  given  by  Wilkinson  (Ref.  6).  In  this  method  each 
terms  in  the  normal  equation  is  divided  by  the  square  root  of  the  sum  of  the  squares  of  its 
coefficients  and  then  the  determinant  of  the  normalized  coefficient  matrix  is  evaluated.  The 
smaller  the  magnitude  of  the  normalized  determinant  in  comparison  with  ±1,  the  more  ill- 
conditioned  the  set  is.  Using  this  criteria,  results  for  eight,  nine,  and  ten  variables  are  an  order 
of  magnitude  worse  than  the  7-variable  level. 

A regression  analysis  of  OPR  rather  than  A8  as  the  eighth  variable  in  an  8-variable  analysis 
of  TOGW  shows  similar  regression  statistics  and  conditioning  of  the  matrix.  This  would  indicate 
that  the  first  seven  variables  selected  for  this  study  are  the  primary  drivers  upon  TOGW  and  that 
variables  such  as  A8,  OPR,  and  AR  (for  the  range  of  values  studied)  may  have  significantly  less 
influence  upon  TOGW. 
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C.  TAKEOFF  DISTANCE  RESULTS 


Regression  simulation  of  takeoff  distance  proved  to  be  easy  and  to  provide  excellent 
regression  statistics  when  transformations  were  used.  Results  are  presented  in  Tables  22  through 
29. 


Table  22.  Takeoff  Distance  — 5 Variable  Regres- 
sion, Full  Replication 


No.  of  Point*  Fit 

43 

Total  Point*  Checked 

43 

Max  % Error 

1.01 

Average  Delta 

3.63 

SEE 

7.86 

Average,  % 

0.16 

PEE 

0.33 

R* 

0.9999 

Derivative  Exponent,  N 

-2 

Table  23.  Takeoff  Distance  — 6 Variable  Regres- 
sion, Full  Replication 


No.  of  Point*  Fit  77 

Total  Point*  Checked  77 

Max  Error  0.90 

Average  Delta  2.75 

SEE  5.44 

Average.  0.12 

PEE  0.23 

R*  0.9999 

Derivative  Exponent,  N -2 


Table  24.  Takeoff  Distance  — 7 Variable  Regres- 
sion, Full  Replication 

No.  of  Points  Fit 

143 

Total  Point*  Checked 

143 

Max  fr  Error 

0.79 

Average  Delta 

14.30 

SEE 

20.37 

Average,  cr 

0.43 

PEE 

0.53 

R* 

0.9999 

Derivative  Exponent,  N 

-I 

Table  25.  Takeoff  Distance  — 8 Variable  Regres- 
sion, Full  Replication 

No.  of  Points  Fit 

273 

273 

Total  Points  Checked 

273 

309 

Max  cr  Error 

0.92 

1.48 

Average  Delta 

14.78 

13.92 

SEE 

20.01 

18.92 

Average, 

0.44 

0.43 

PEE 

0.51 

0.51 

R* 

0.9999 

— 

Derivative  Exponent,  N 

-1 

— 
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Table  26.  Takeoff  Distance  — 8 Variable  Regres- 
sion, Half  Replication 


No.  of  Points  Fit 

146 

146 

146 

Total  Points  Checked 

146 

273 

309 

Max  % Error 

0.90 

0.94 

1.38 

Average  Delta 

14.17 

14.70 

13.85 

SEE 

21.44 

19.96 

18.87 

Average.  % 

0.42 

0.44 

0.42 

PEE 

0.56 

0.61 

0.51 

R* 

0.9999 

— 



Derivative  Exponent,  N 

-1 

— 

— 

Table  27.  Takeoff  Distance  — 9 Variable  Regres- 
sion, Half  Replication 


No.  of  Points  Fit 

275 

275 

275 

Total  Points  Checked 

275 

403 

455 

Max  % Error 

1.07 

1.07 

1.38 

Average  Delta 

14.74 

14.97 

14.11 

SEE 

20.76 

20.11 

19.07 

Average,  % 

0.44 

0.44 

0.43 

PEE 

0.53 

0.51 

0.51 

R’ 

0.9999 

— 

— 

Derivative  Exponent,  N 

-1 

— 

— 

Table  28.  Takeoff  Distance  — 9 Variable  Regres- 
sion, Quarter  Replication 


No.  of  Points  Fit 

147 

147 

147 

Total  Points  Checked 

147 

403 

466 

Max  tr  Error 

1.07 

30.46 

30.46 

Average  Delta 

13.73 

323.76 

287.68 

SEE 

22.24 

627.70 

586.54 

Average,  °r 

0.40 

9.23 

8.22 

PEE 

0.57 

15.01 

14.01 

R* 

0.9999 

— 



Derivative  Exponent,  N 

-1 

— 

— 

Table  29.  Takeoff  Distance  — 10  Variable  Regres- 
sion, Quarter  Replication 


No.  of  Points  Fit 

277 

277 

277 

Total  Points  Checked 

277 

533 

603 

Max  % Error 

1.02 

1.11 

1.23 

Average  Delta 

14.66 

16.12 

14.06 

SEE 

21.08 

20.06 

18.96 

Average,  % 

0.43 

0.44 

0.42 

PEE 

0.54 

0.51 

0.50 

R* 

0.9999 

— 

— 

Derivative  Exponent,  N 

-1 

— 

— 

i 
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Discussion  of  Takooff  Distance  Regression  Accuracy 

Table  30  presents  replication  patterns  studied  for  each  of  the  number  of  variables 
considered. 

Table  30.  Takeoff  Distance  Replication  Pat- 
terns Studied 


Number  of 
Variable*  Regretted 

5 6 7 8 

9 10 

Full  Replication 

Half  Replication 
Quarter  Replicetion 

X X X X 
X 

X 

X X 

The  regression  statistics  show  maximum  percent  error  for  regressed  values  of  takeoff 
distance  of  approximately  1%  and  average  percent  errors  of  0.4%.  For  each  case,  transformation 
methodology  was  used  to  reduce  the  errors  from  a 12  to  30%  range  to  a 1%  level.  Results  for  takeoff 
distances  prediction  on  a per  variable  replication  basis  appear  to  be  similar  to  results  obtained  for 
TOGW  (see  figure  36).  Thus,  a half  replication  pattern  should  be  sufficient  to  accurately 
represent  takeoff  distance  surfaces  for  6-  through  9-variabies,  and  quarter  replication  for  ten 
variables.  Note  that  for  the  9-variable  quarter  replication  case,  examination  of  the  check  point 
results  shows  that  the  quarter  replication  pattern  provides  too  few  points.  This  is  the  same  result 
seen  in  the  TOGW  regression  study.  Examination  of  check  points  for  the  10-variable  quarter 
replication  shows  that  277  data  points  are  sufficient  to  regress  the  takeoff  distance  surface  for 
10- variables. 
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Figure  36.  Takeoff  Distance  Results  Sum  mao' 


0.  COMBAT  ACCELERATION  TIME  RESULTS 

Regression  simulation  of  combat  accel  time  required  transformation  methods  to  obtain 
surface  fit  accuracies  that  were  good  but  not  excellent.  Results  are  presented  in  Tables  31  through 
36. 
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Table  31.  Combat  Acceleration  Time  — 5 Vari- 
able Regression,  Full  Replication 


No.  of  Point*  Fit 

43 

Total  Points  Checked 

43 

Max  % Error 

3.51 

Average  Delta 

0.67 

SEE 

1.59 

Average,  % 

0.66 

PEE 

1.39 

R* 

0.9998 

Derivative  Exponent,  N 

-2 

Table  32.  Combat  Acceleration  Time  — 6 Vari- 
able Regression,  Full  Replication 


No.  of  Point*  Fit 

77 

Total  Points  Checked 

77 

Max  % Error 

4.61 

Average  Delta 

0.62 

SEE 

1.63 

Average,  % 

0.67 

PEE 

1.38 

R* 

0.9997 

Derivative  Exponent,  N 

-2 

Table  33.  Combat  Acceleration  Time  — 7 Vari- 
able Regression,  Full  Replication 


No.  of  Points  Fit 

143 

Total  Points  Checked 

143 

Max  % Error 

4.67 

Average  Delta 

0.60 

SEE 

1.31 

Average,  % 

0.70 

PEE 

1.21 

R* 

0.9997 

Derivative  Exponent,  N 

-2 

Table  34.  Combat  Acceleration  Time  — 8 Vari- 
able Regression,  Full  Replication 


No.  of  Points  Fit 

273 

273 

Total  Points  Checked 

273 

309 

Max  % Error 

9.67 

9.67 

Average  Delta 

1.23 

1.16 

SEE 

2.41 

2.26 

Average,  % 

1.37 

1.36 

PEE 

2.07 

2.00 

R* 

0.9993 

— 

Derivative  Exponent,  N 

-2 

— 
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Table  35.  Combat  Acceleration  Time  — 9 Vari- 
able Regression,  Half  Replication 


No.  of  Point*  Fit 
Total  Points  Checked 
Max  % Error 
Average  Delta 
SEE 

Average,  % 

PEE 

R* 

Derivative  Exponent,  N 


276 

276 

276 

276 

403 

466 

7.97 

10.03 

10.03 

1.14 

1.20 

1.13 

2.27 

2.34 

2.22 

1.27 

1.33 

1.29 

2.01 

2.03 

1.97 

0.9993 

— 

— 

-2 

. — 

. 

Table  36.  Combat  Acceleration  Time  — 10  Vari- 
able Regression,  Quarter  Replication 


No.  of  Point*  Fit 

277 

277 

277 

Totxl  Point*  Checked 

277 

633 

603 

Max  ^ Error 

7.71 

9.90 

9.90 

Average  Delta 

1.18 

1.29 

1.21 

SEE 

2.49 

2.49 

2.36 

Average,  % 

1.27 

1.41 

1.37 

PEE 

2.06 

2.16 

2.08 

R* 

0.9994 

— 

— 

Derivative  Exponent,  N 

-2 

— 

— 

Discussion  of  Combat  Accsl  Tima  Regression  Accuracy 

Table  37  presents  replication  patterns  studied  for  each  of  the  numbers  of  variables 
considered. 

Table  37.  Combat  Acceleration  Time  Replica- 
tion Patterns  Studied 


Number  of 
Variable!  Regretted 
Full  Replication 
Half  Replication 
Quarter  Replication 


6 6 7 8 9 10 

X X X x 

X 

X 


Figure  37  shows  that  there  are  two  levels  of  accuracy  in  predicting  combat  accel  time  and 
that  these  levels  are  a function  of  the  numbers  of  variables  considered.  For  the  full  replication 
regression  of  5-,  6-,  and  7-variables,  the  accuracy  is  excellent  with  the  maximum  percent  error 
hovers  around  4.5%,  and  an  average  percent  error  of  0.7%.  For  replication  patterns  studied  for 
8-,  9-,  and  10-variables  the  maximum  percent  error  increases  to  somewhat  less  than  10%  and  an 
average  error  of  1.3%.  Although  these  errors  are  somewhat  higher,  the  correlation  coefficient 
would  indicate  that  99.93%  of  the  variation  of  the  data  is  being  accounted  for  with  the  regression 
equations  developed. 

Results  of  the  study  indicate  that  this  variable  is  similar  to  TOGW  and  TO  distance  in 
terms  of  the  numbers  and  points  required  as  input  to  the  regression  in  order  to  sufficiently 
describe  the  surface. 
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Figure  37.  Combat  Acceleration  Time  Results  Summary 

E.  COMBAT  Q-LOAD  RESULTS 

Regression  simulation  of  combat  g-load  proved  to  be  straightforward,  and  excellent 
regression  statistics  were  obtained.  Results  are  presented  below  in  Tables  38  through  44. 


Table  38.  Combat  g Load  — 5 Variable  Regres- 
sion, Full  Replication 


No.  of  Points  Fit 

43 

Total  Points  Checked 

43 

Ms*  % Error 

0.66 

Average  Delta 

0.00 

SEE 

0.01 

Average,  % 

0.17 

PEE 

0.31 

R* 

0.9998 

Derivative  Exponent,  N 

0 

Table  39.  Combat  g Load  — 6 Variable  Regres- 
sion, Full  Replication 


No.  of  Points  Fit 

77 

Total  Points  Checked 

77 

Max  % Error 

0.66 

Average  Delta 

0.00 

SEE 

0.01 

Average,  % 

0.16 

PEE 

0.24 

R* 

0.9999 

Derivative  Exponent,  N 

0 
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Table  40.  Combat  g Load  — 7 Variable  Regres- 
sion,  Full  Replication 


No.  of  Points  Fit 
Total  Points  Checked 
Max  % Error 
Average  Delta 
SEE 

Average,  % 

PEE 

R* 

Derivative  Exponent,  N 


Table  41.  Combat  g Load  — 8 Variable  Regres- 
sion, Full  Replication 


No.  of  Points  Fit 
Total  Points  Checked 
Max  % Error 
Average  Delta 
SEE 

Average,  % 

PEE 

R* 

Derivative  Exponent,  N 


Table  42.  Combat  g Load  — 8 Variable  Regres- 
sion, Half  Replication 


No.  of  Points  Fit 

146 

146 

146 

Total  Points  Checked 

146 

273 

309 

Max  % Error 

1.34 

1.34 

1.34 

Average  Delta 

0.01 

0.01 

0.01 

SEE 

0.01 

0.01 

0.01 

Average,  % 

0.29 

0.30 

0.31 

PEE 

0.46 

0.41 

0.43 

R* 

0.9996 

— 

— 

Derivative  Exponent,  N 


Table  43.  Combat  g Load  — 9 Variable  Regres- 
sion, Half  Replication 


No.  of  Points  Fit 

276 

276 

276 

Total  Points  Checked 

276 

403 

466 

Max  % Error 

1.68 

1.58 

1.68 

Average  Delta 

0.01 

0.01 

0.01 

SEE 

0.01 

0.01 

0.01 

Average,  % 

0.33 

0.32 

0.34 

PEE 

0.48 

0.46 

0.47 

R* 

0.9994 

— 

— 

Derivative  Exponent,  N 0 — — 

Table  44.  Combat  g Load  — 10  Variable  Regres- 
sion, Quarter  Replication 


No.  of  Points  Fit 

277 

2 77 

277 

Total  Points  Checked 

277 

633 

603 

Max  % Error 

3.82 

3.82 

4.13 

Average  Delta 

0.02 

0.03 

0.03 

SEE 

0.03 

0.03 

0.04 

Average,  % 

0.96 

1.08 

1.17 

PEE 

1.40 

1.43 

1.62 

R* 

0.9970 

— 

— 

Derivative  Exponent,  N 

0 

— 

— 
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Discussion  of  Combat  g-Losd  Rogrosalon  Accuracy 


Table  46  presents  replication  patterns  studied  for  each  of  the  numbers  of  variables 
considered. 

Table  45.  Combat  g-Loading  Replication  Pat- 
terns Studied 


Number  of 
Variablei  Regretted 
Full  Replication 
Half  Replication 
Quarter  Replication 


5 6 7 8 9 10 

X X X X 

X X 

X 


A summary  of  results  is  presented  in  figure  38.  Regression  statistics  presented  show  that  for 
surface  fitting,  and  5-  through  9- variables,  maximum  percent  errors  less  than  1.5%  were  obtained 
and  that  at  the  10-variable  level  a maximum  percent  error  less  than  4%  was  obtained.  In  general, 
the  average  errors  were  0.3%,  except  the  10- variable  case  where  approximately  1%  average  errors 
were  obtained. 


Number  of  Independent  Variables 

n>  140490 

Figure  38.  Combat  g-Load  Results  Summary 


F.  LANDING  VKLOCITY  RESULTS 

Regression  simulation  of  landing  velocity  proved  to  be  straightforward  and  excellent 
regression  statistics  were  obtained.  Results,  in  tabular  form  are  presented  in  Tables  46 
through  61. 
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Table  46.  Landing  Velocity  — 5 Variable  Regres- 
aion,  Half  Replication 


No.  of  Points  Fit 

27 

27 

Total  Points  Checked 

27 

43 

Max  % Error 

0.31 

0.38 

Average  Delta 

0.10 

0.12 

SEE 

0.30 

0.23 

Average,  % 

o.oe 

0.10 

PEE 

0.24 

0.19 

R* 

0.9999 



Derivative  Exponent,  N 

0 

— 

Table  47.  Landing  Velocity  — 6 Variable  Regres- 
sion, Half  Replication 


No.  of  Points  Fit 

46 

46 

46 

Total  Points  Checked 

46 

77 

87 

Max  % Error 

0.62 

0.62 

0.98 

Average  Delta 

0.19 

0.20 

0.24 

SEE 

0.38 

0.31 

0.37 

Average,  % 

0.16 

0.16 

0.19 

PEE 

0.30 

0.24 

0.30 

R* 

0.9996 

— 

— 

Derivative  Exponent,  N 

0 

— 

— 

Table  48.  Landing  Vebcity  — 7 Variable  Regres- 
sion, Half  Replication 


No.  of  Points  Fit 

79 

79 

79 

Total  Points  Checked 

79 

143 

166 

Max  ^ Error 

0.76 

0.97 

1.26 

Average  Delta 

0.34 

0.31 

0.33 

SEE 

0.68 

0.46 

0.48 

Average,  % 

0.23 

0.21 

0.23 

PEE 

0.38 

0.31 

0.35 

R* 

0.9998 

— 

— 

Derivative  Exponent,  N 

0 

— 

— 

Table  49.  Landing  Velocity  — 8 Variable  Regres- 
sion, Half  Replication 


No.  of  Points  Fit 

146 

146 

146 

Total  Points  Checked 

146 

278 

309 

Max  % Error 

0.90 

0.90 

1.37 

Average  Delta 

0.32 

0.32 

0.35 

SEE 

0.60 

0.44 

0.49 

Average,  % 

0.21 

0.21 

0.24 

PEE 

0.33 

0.29 

0.36 

R* 

0.9998 

— 

— 

Derivative  Exponent,  N 

0 

— 

— 

Table  50.  Landing  Velocity  — 9 Variable  Regres- 
f sion,  Half  Replication 


No.  of  Point!  Fit 

275 

275 

275 

Total  Points  Checked 

276 

403 

455 

Max  ‘7  Error 

1.49 

1.49 

1.49 

Average  Delta 

0.39 

0.39 

0.40 

SEE 

0.56 

0.53 

0.54 

Average,  % 

0.26 

0.25 

0.27 

PEE 

0.37 

0.35 

0.36 

R* 

0.9998 

— 

Derivative  Exponent,  N 

0 

— 

— 

Table  51.  Landing  Velocity  — 10  Variable  Regres- 
sion, Quarter  Replication 


No.  of  Points  Fit 

277 

277 

277 

Total  Points  Checked 

277 

533 

603 

Max  % Error 

1.42 

1.42 

1.42 

Average  Delta 

0.41 

0.41 

0.42 

SEE 

0.60 

0.56 

0.56 

Average,  % 

0.26 

0.27 

0.27 

PEE 

0.39 

0.36 

0.37 

R’ 

0.9998 

— 

— 

Derivative  Exponent,  N 

0 

— 

— 

Discussion  of  Landing  Velocity  Rsgrssslon  Accuracy 

Table  52  presents  replication  patterns  studied  for  each  of  the  numbers  of  variables 
considered. 

For  each  of  the  numbers  of  variables  examined,  excellent  regression  statistics  were  obtained 
for  regressed  values  of  landing  velocity  without  transformations.  Regression  of  half  replication 
pattern  of  velocity  as  a function  of  5-,  6-,  7-,  and  8- variables  resulted  in  maximum  percent  errors 
less  than  1%.  Results  for  9-  and  10-variable  cases  show  only  slightly  higher  maximum  percent 
errors  of  1.5%.  Inspection  of  check  data,  shown  graphically  in  Figure  39,  for  each  of  these 
regression  cases,  shows  similar  maximum  and  average  percent  errors. 

Thus,  a half  replication  pattern  is  sufficient  to  accurately  represent  landing  velocity 
surfaces  for  5-  through  9-variables.  Quarter  replication  provides  sufficient  points  to  accurately 
represent  10  variables. 


Table  52.  Landing  Velocity  Replication  Pat- 
terns Studied 


Number  of 
Variables  Regressed 

S 6 7 8 9 10 

Full  Replication 

Half  Replication 
Quarter  Replication 

X X X X X 

X 

8ECTI0N  VI 
CONCLUSIONS 


During  the  Regression  Simulation  of  Turbine  Engine  Performance  (RSTEP)  Task  IV  study, 
the  Central  Composite  Design  (CCD)  pattern  was  evaluated  as  an  alternate  to  the  Orthogonal 
Latin  Square  (OLS)  design  selector  used  in  Turbine  Engine  Variable  Cycle  Selection  Study 
(TEVCS),  Airplane  Responsive  Engine  Selection  Study  (ARES).  The  investigation  included  the 
systematic  evaluation  of  the  impact  of  the  number  of  independent  variables  and  the  number  of 
data  points  on  regression  accuracy.  Four  approaches  to  improve  the  accuracy  of  the  regression 
equation  form  were  also  investigated.  The  conclusions  drawn  from  the  results  of  this  study  are 
presented  below. 

• The  CCD  design  selector  provides  a flexible,  accurate,  and  economical 
alternate  to  the  OLS  design  selector.  Data  generation  cost  of  the  CCD  design 
selector  ranges  from  a 60%  reduction  (compared  to  the  OLS  cost)  for  a 5- 
variable  problem  to  a 22%  reduction  for  9-  and  10-variable  problems. 

• Satisfactory  regression  accuracy  is  obtained  with  half  replication  of  the  CCD 
pattern  for  5-  through  9-variable  problems,  and  quarter  replication  for  10- 
variable  problems. 

• Transformation  of  the  dependent  variable  is  the  single  most  powerful  tool 
studied.  A maximum  error  of  34%  obtained  by  traditional  regression  of  Take- 
Off  Gross  Weight  (TOGW)  was  reduced  to  12%  by  application  of  Trans- 
formation methodology. 

• Role  Reversal  methodology  provides  a means  to  obtain  further  significant 
accuracy  improvement  by  reducing  the  maximum  TOGW  error  from  12%  to 

7%. 

• Statistics  based  on  data  used  in  the  regression  are  not  a reliable  indication  of 
the  regression  surface  accuracy.  Check  points  provide  a means  of  obtaining 
greater  confidence  in  the  accuracy  level. 


i 
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SECTION  VII 
RECOMMENDATIONS 


Based  on  results  of  the  Regression  Simulation  of  Turbine  Engine  Performance  (RSTEP) 
Task  IV  Program,  three  recommendations  about  future  regression  analysis  of  airframe/propulsion 
systems  have  been  developed: 

• Transformations  and  Role  Reversal  methodologies  have  proven  to  be  very 
effective  in  improving  surface  fit  accuracy  and  should  be  incorporated  into 
future  studies. 

• The  Central  Composite  Design  (CCD)  design  selector  provides  a flexible, 
accurate,  and  economical  alternative  to  the  Orthogonal  Latin  Square  (OLS) 
design  selector.  Therefore,  the  CCD  pattern  should  be  considered  for  future 
studies. 

• Data  points  additional  to  those  used  in  the  regression  should  be  generated 
and  used  to  check  the  regression  surface  accuracy. 

• A back-to-back  accuracy  comparison  of  other  design  selection  patterns  such 
as  Latin  Squares  and  DN  optimal  should  be  investigated  over  a range  of 
numbers  of  independent  variables.  The  comparison  should  be  made  on  the 
basis  of  regression  statistics  and  constrained  optimal  surface  prediction 
accuracy. 


APPENDIX  A 

PHASE  II  DATA  R8TEP  TASK  IV  STUDY 


! 

The  following  computerized  listing  presents  data  generated  by  the  Boeing  Company  under 
contract  to  P&WA.  The  listing  includes  17  parameters  consisting  of  data  point  numbers, 
independent  variables,  dependent  variables,  and  a replication  code. 

The  first  column  is  the  data  point  number  used  to  identify  individual  data.  The  next  five 
columns  present  dependent  variables  or  fall-outs  from  the  mission  calculation.  The  seventh 
through  sixteenth  columns  list  the  independent  variables  used  as  input  to  the  Boeing  BEAM 
calculation.  The  last  column  presents  the  replication  code.  This  six-digit  code  is  used  to  define 
points  in  the  CCD  pattern  that  are  used  with  specific  numbers  and  variables  and  breaks  out  how 
these  points  are  used  in  replications. 

Each  digit  in  the  code  corresponds  with  a specific  number  of  variables  to  be  regressed.  Digit 
one  is  for  five  variables,  digit  two  is  for  six  variables,  etc...  Each  of  these  digits  can  have  four 
possible  values  (0, 1, 2,  or  3).  Zero  means  that  the  data  point  is  not  used  in  any  replication  pattern 
of  the  specified  number  of  variables  considered.  A 1 in  the  code  means  that  the  data  point  is  used 
in  full  replication  only.  A 2 means  that  the  data  point  is  used  in  both  full  and  half  replication.  A 
3 in  the  code  means  the  point  is  used  in  full,  half,  and  quarter  replication.  Note  that  points  used 
in  half  (or  quarter)  replication  are  always  used  in  full  replication,  but  that  a point  in  full  (or  half) 
replication  may  not  necessarily  be  included  in  a half  (or  quarter)  replication  pattern. 

Example:  001230 


This  data  point  is  not  used  in  the  five,  six,  or  ten  variable  CCD  patterns.  The  point  is  used 
in  full,  but  not  half  or  quarter  replication  of  seven  variables.  The  point  is  used  in  full  and  half 
replication  of  eight  variables.  The  same  data  is  used  in  full,  half,  and  quarter  replication  of  the 
ninth  variable. 
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APPENDIX  B 

•AMPLE  REQRE88I0N  RE8ULT8 


The  following  computerized  listing  is  a sample  output  of  the  regression  routine  used  in  the 
RSTEP  TASK  IV  Study.  The  example  presented  in  a forced  second  order  polynomial  regression 
of  the  log  of  TOGW  for  a half  replication  CCD  pattern  as  a function  seven  variables.  The  major 
subsections  of  the  printout  are  described  below: 

General  Processor  — Data  used  in  the  regression. 

Check  Points  (1st  Set)  — Data  points  excluded  from  the  regres- 

sion because  they  are  not  required  in  the 
replication. 

Check  Points  (2nd  Set)  — Data  points  excluded  from  the  regres- 

sion because  they  are  not  included  in  the 
data  required  for  the  number  of  vari- 
ables considered. 

Regression  Equation  Coefficients  — Listing  of  dependent  variable  and  cor- 
responding regression  equation. 

Quadratic  Solution  — Quadratic  solution  for  the  independent 

variable  dash  range  for  each  of  the  sets 
of  data  points  noted  above.  Note  that 
some  of  the  large  percent  errors  in  dash 
radius  are  due  to  near  zero  values  of 
dash  radius. 


RSTEP  UTILITY  PROGRAM 
TRIAL*  l. 


GENERAL  PROCESSOR  ( TRANSFORMATIONS+CHECn  PTS) 


roBS 

YCALC 

DEL 

PERCENT 

PT  NO 

1 

79999.875 

81556.375 

1556.500 

1.95 

10 

2 

39999.930 

41936.402 

1436.473 

3.59 

13 

3 

79999.875 

76141.812 

-3858.062 

-4.82 

15 

A 

39999.930 

40382.801 

382.871 

0.96 

16 

5 

79999.875 

78544.125 

“1455.750 

-1.82 

20 

6 

39999.930 

40882.168 

862.238 

2.21 

21 

7 

79999.875 

78021.250 

-1978.625 

-2.47 

23 

8 

39999.930 

41385.102 

1385.172 

3.46 

26 

9 

39999.930 

39725.074 

“274.855 

-0.69 

28 

10 

79999.875 

78718.375 

-1281.500 

-1.60 

29 

11 

39999.930 

40497.418 

497.488 

1.24 

31 

12 

79999.875 

80017.812 

17.938 

0.02 

34 

13 

39999.930 

40881.348 

881.418 

2.20 

36 

19 

79999.875 

82835.187 

2835.312 

3.54 

39 

15 

39999.930 

39297.328 

-702.602 

-1.76 

41 

16 

79999.875 

75475.250 

-4524.625 

-5.66 

42 

17 

59999.895 

62003.816 

2003.922 

3.34 

49 

18 

39999.930 

39771.17 2 

-228.758 

-0.57 

55 

19 

79999.875 

83259.375 

3259.500 

4.07 

58 

20 

79999.875 

81371.000 

1371.125 

1.71 

60 

21 

39999.930 

38976.605 

-1023.324 

-2.56 

61 

22 

79999.875 

81489.187 

1489.312 

1.86 

64 

23 

39999.930 

40688.191 

688.262 

1.72 

65 

29 

39999.930 

40134.012 

134.082 

0.34 

67 

25 

79999.875 

76940.125 

-3059.750 

-3.8  2 

70 

26 

79999.875 

76285.062 

-3714.812 

-4.64 

73 

27 

39999.930 

40294.816 

294.887 

0.74 

74 

28 

39999.930 

40535.172 

535.242 

1.34 

76 

29 

79999.875 

80162.187 

162.312 

0.20 

79 

30 

39999.930 

40283.754 

283.824 

0.71 

80 

31 

79999.875 

77919.000 

-2080.875 

-2.60 

83 

32 

79999.875 

82121.875 

2122.000 

2.65 

85 

33 

39999.930 

38576.078 

-1423.852 

-3.56 

86 

39 

59999.895 

57690.109 

-2309.785 

-3.85 

88 

35 

59999.895 

60585.984 

586.090 

0.98 

89 

36 

59999.895 

59526.102 

-473.793 

-0.79 

90 

37 

59999.895 

58308.332 

-1691.562 

-2.82 

91 

38 

59999.895 

59876.824 

-123.070 

-0.21 

92 

39 

39999.930 

36630.324 

-3369.605 

-8.42  MAX 

93 

90 

59999.895 

60324.582 

324.687 

0.54 

94 

91 

79999.875 

76950.250 

-3049.625 

-3.81 

95 

92 

59999.895 

62133.391 

2133.496 

3.56 

96 

93 

59999.895 

63601.504 

3601.609 

6.00 

97 

99 

59999.895 

62499.355 

2499.461 

4.17 

98 

95 

59999.895 

62732.004 

2732.109 

4.55 

99 

96 

59999.895 

60367.687 

367.793 

74 

0.61 

100 

47 

39999.930 

40450.328 

450.398 

1.13 

101 

48 

79999.875 

80253.562 

253.687 

0.32 

104 

49 

79999.875 

78743.062 

-1256.812 

-1.57 

106 

50 

39999.930 

39293.879 

-706.051 

-1.77 

107 

51 

79999.875 

84238.062 

4238.187 

5.30 

110 

52 

39999.930 

40219.875 

219.945 

0.55 

111 

53 

39999.930 

39880.289 

-119.641 

-0.30 

113 

54 

79999.875 

80735.312 

735.437 

0.92 

116 

55 

79999.875 

79982.125 

-17.750 

-0.02 

118 

56 

39999.930 

40297.930 

298.000 

0.75 

119 

57 

39999.930 

41984.941 

1985.012 

4.96 

121 

58 

79999.875 

78801.000 

-1198.875 

-1.50 

124 

59 

39999.930 

38557.945 

-1441.984 

-3.60 

125 

60 

79999.875 

79255.687 

-744.187 

-0.93 

128 

61 

79999.875 

79690.437 

-309.437 

-0.39 

130 

62 

39999.930 

39101.922 

-898.008 

-2.25 

131 

63 

59999.895 

60324.582 

324.687 

0.54 

133 

64 

79999.875 

83903.750 

3903.875 

4.88 

135 

65 

39999.930 

39358.387 

-641.543 

-1.60 

136 

66 

39999.930 

40659.410 

659.480 

1.65 

138 

67 

79999.875 

78822.812 

-1177.062 

-1.47 

141 

68 

39999.930 

39135.684 

-864.246 

-2.16 

142 

69 

79999.875 

75425.562 

-4574.312 

-5.72 

145 

70 

79999.875 

75263.062 

-4736.812 

MAX  -5.92 

147 

71 

39999.930 

43216.879 

3216.949 

8.04 

148 

72 

39999.930 

40324.305 

324.375 

0.81 

150 

73 

79999.875 

79439.375 

-560.500 

-0.70 

153 

74 

79999.875 

77813.437 

-2186.437 

-2.73 

155 

75 

39999.930 

39430.633 

-569.297 

-1.42 

156 

76 

79999.875 

81557.750 

1557.875 

1.95 

159 

77 

39999.930 

40749.082 

749.152 

1.87 

160 

78 

39999.930 

39106.398 

-893.531 

-2.23 

162 

79 

79999.875 

83793.437 

3793.562 

4.74 

le5 

1477.17  2647.45 


2.40 


4.11  0.9908 


CHECK  POINTS 


r 


f 


I 

t 


! 


[ 


YOBS 

YCALC 

DEL 

PEKCfcNT 

PT  NO 

1 

39999.930 

42131.141 

2131.211 

5.33 

11 

2 

79999.875 

76765.625 

-3234.250 

-4.04 

12 

3 

39999.930 

42260.395 

2260.465 

5.65 

14 

4 

79999.875 

77769.750 

-2230.125 

-2.79 

17 

5 

39999.930 

40181.996 

182.066 

0.46 

19 

6 

79999.875 

72515.000 

-7484.875 

MAX  -9.36  MAX 

22 

7 

39999.930 

39404.469 

-595.461 

-1.49 

24 

8 

79999.875 

79027.312 

-972.562 

-1.22 

25 

9 

79999.875 

81198.437 

1198.562 

1.50 

27 

10 

39999.930 

39498.305 

-501.625 

-1.25 

30 

11 

79999.875 

78840.500 

-1159.375 

-1.45 

32 

12 

39999.930 

41421.668 

1421.738 

3.55 

33 

13 

79999.875 

82285.125 

2285.250 

2.86 

37 

14 

39999.930 

38100.918 

-1899.012 

-4.7  5 

38 

15 

79999.875 

83064.062 

3064.187 

3.83 

hO 

16 

39999.930 

40579.148 

579.219 

1.45 

43 

17 

79999.875 

75740.062 

-4259.812 

-5.32 

56 

18 

39999.930 

37277.953 

-2721.977 

-6.80 

57 

19 

39999.930 

40934.172 

934.242 

2.34 

59 

20 

79999.875 

80599.562 

599.687 

0.75 

62 

21 

39999.930 

40220.375 

220.445 

0.55 

63 

22 

79999.875 

85626.562 

5626.687 

7.03 

66 

23 

79999.875 

75046.375 

-4953.500 

-6.19 

68 

24 

39999.930 

39896.609 

-103.320 

-0.26 

69 

25 

39999.930 

39289.383 

-710.547 

-1.78 

72 

26 

79999.875 

81275.312 

1275.437 

1.59 

75 

27 

79999.875 

74692.562 

-5307.312 

—6.63 

77 

28 

39999.930 

38418.137 

-1581.793 

-3.95 

78 

29 

79999.875 

78859.750 

-1140.125 

-1.43 

81 

30 

39999.930 

41652.133 

1652.203 

4.13 

82 

31 

39999.930 

40794. 809 

794.879 

1.99 

84 

32 

79999.875 

84675.000 

4675.125 

5.84 

87 

33 

79999.875 

81672.500 

1672.625 

2.09 

102 

34 

39999.930 

39537.875 

-462.055 

-1.16 

103 

35 

39999.930 

38650.168 

-1349.762 

-3.37 

105 

36 

79999.875 

79851.437 

-148.437 

-0.19 

108 

37 

39999.930 

39274.398 

-725.531 

-1.81 

109 

38 

79999.875 

78664.125 

-133*^.750 

-1.67 

112 

39 

79999.875 

76959.437 

-3040.437 

-3.80 

114 

40 

39999.930 

42384.910 

2384.980 

5.96 

115 

41 

39999.930 

41053.020 

1053.090 

2.63 

117 

42 

79999.875 

79154.625 

-845.250 

-1.06 

120 

43 

79999.875 

77892.812 

-2107.062 

-2.63 

122 

44 

39999.930 

41199.035 

1199.105 

3.00 

123 

45 

79999.875 

75128.625 

-4871.250 

—6.09 

126 

46 

39999.930 

39614.191 

-385.738 

-0.96 

127 

47 

39999.930 

39231.387 

-768.543 

-1.92 

129 

48 

79999.875 

84464.750 

4464.875 

5.58 

132 

49 

39999.930 

40387.922 

387.992 

0.97 

134 

50 

79999.875 

81554.562 

1554.687 

1.94 

137 

76 


51 

79999.875 

79310.187 

-689.687 

—0.86 

139 

52 

39999.930 

40473.789 

473.859 

1.18 

140 

53 

79999.875 

79611.750 

-386.125 

-0.49 

143 

54 

39999.930 

39709.129 

-290.601 

-0.73 

144 

55 

39999.930 

41390.195 

1390.266 

3.48 

146 

56 

79999.875 

78168.812 

-1831.062 

-2.29 

149 

57 

79999.875 

80979.437 

979.562 

1.22 

151 

58 

39999.930 

39457.492 

-542.437 

-1.36 

152 

59 

39999.930 

40455.574 

455.645 

1.14 

154 

60 

79999.875 

82786.562 

2786.687 

3.48 

157 

61 

39999.930 

38763.457 

-1236.473 

-3.09 

158 

62 

79999.875 

81004.125 

1004.250 

1.26 

161 

63 

79999.875 

81966.062 

1966.187 

2.46 

163 

64 

39999.930 

40328.918 

328.988 

0.82 

164 

CUMULATIVE 


AVG  DEL 

SEE 

AVG  PERCENT 

PEE 

R2 

1591.42 

2461.90 

2.57 

3.73 

0.9908 

CHECK  POINTS 


YOBS  YCALC 

1 59999.895  59640.715 

2 39999.930  37065.785 

3 59999.895  58883.738 

4 79999.875  75517.062 

5 59999.895  60030.172 

6 59999.895  57479.723 

7 59999.895  59125.930 

8 59999.895  59992.113 

9 59999.895  62195.934 

10  59999.895  60541.340 

11  59999.895  64519.285 

12  59999.895  63925.984 

13  59999.895  61636.754 

14  59999.895  60486.859 

15  59999.895  61100.371 

16  39999.930  37898.484 

17  79999.875  79258.250 

18  59999.895  64864.031 

19  59999.895  65372.207 

20  59999.895  64240.723 

21  59999.895  64738.086 

22  59999.895  bl7bl.910 


OEL 

PERCENT 

-359.180 

-0.60 

-2934.145 

-7.34 

-1116.156 

-1.86 

-4482.812 

-5.60 

30.277 

0.05 

-2520.172 

-4.2  0 

-873.965 

-1.46 

-7.781 

-0.01 

2196.039 

3.66 

541.445 

0.90 

4519.391 

7.53 

3926.090 

6.54 

1636.859 

2.73 

486.965 

0.81 

1100.477 

1.83 

-2101.445 

-5.25 

-741.625 

-0.93 

4864.137 

8.11 

5372.312 

MAX  8.95  MAX 

4240.828 

7.07 

4738.191 

7.90 

1762.016 

2.94 

PT  NO 

1. 

2. 

3. 

4. 

5. 
6 • 

7. 

8. 
9. 

18. 

35. 

44. 

45. 

46. 

47. 

48. 

50. 

51. 

52. 

53. 

54. 
71. 


CUMMUUATIVE 

AVG  DEL  SEE  AVG  PERCENT  PEE  R2 

1685.60  2539.34  2*75  3.9b  0.9908 


REGRESSION  EQUATION  COEFFICIENTS 


OEP  VAR 

CONSTANT 

EXPONENT  AO 

LOG  <GM 

♦ 0.0 

)«  0. 

812030+01  + 

TERN  ELEMENT  VARIABLE 

EXPONENT 

I 

1 

BPR 

0.100E+01 

2 

1 

BPR 

0.200E+01 

3 

1 

M/S 

0. 100E+01 

4 

1 

M/S 

0.200E+01 

5 

1 

TR 

0. 100E+01 

6 

1 

TR 

0.2006+01 

7 

1 

RNGE 

0. 100E+01 

8 

1 

RNGE 

0.2006+01 

9 

1 

T/M 

0. 100E+01 

10 

1 

T/M 

0.200E+01 

11 

1 

T4 

0. 100E+01 

12 

1 

T4 

0.2006+01 

13 

1 

SMP 

0. 1006+01 

14 

1 

SMP 

0 . 200E+01 

15 

1 

BPR 

0.1006+01 

2 

M/S 

0. 100E+01 

16 

1 

BPR 

0. 1006+01 

2 

TR 

0.1006+01 

17 

1 

BPR 

0. 1006+01 

2 

RNGE 

0.1006+01 

18 

1 

BPR 

0. 100E+01 

2 

T/M 

0. 1006+01 

19 

1 

BPR 

0. 1006+01 

2 

T4 

0. 1006+01 

20 

1 

BPR 

0.1006+01 

2 

SMP 

0. 100E+01 

21 

1 

M/S 

0. 1006+01 

2 

TR 

0. 1006+01 

22 

1 

M/S 

0.1006+01 

2 

RNGE 

0. 1006+01 

23 

1 

M/S 

0.1006+01 

2 

T/W 

0.1006+01 

24 

1 

M/S 

0. 1006+01 

2 

T4 

0.1006+01 

25 

1 

M/S 

0. 1006+01 

2 

SMP 

0.1006+01 

26 

1 

TR 

0.1006+01 

2 

RNGE 

0.1006+01 

27 

1 

TR 

0.1006+01 

2 

T/W 

0.100E+01 

28 

1 

TR 

0.1006+01 

2 

T4 

0.1006+01 

29 

1 

TR 

0. 100E+01 

2 

SMP 

0.1006+01 

30 

1 

RNGE 

0.1006+01 

2 

T/W 

0.1006+01 

31 

1 

RNGE 

0.1006+01 

2 

T4 

0.1006+01 

COEFFICIENT 

-0. 225950*00 
0.554810-01 
-0.112280-01 
0.486540-04 
-0. 676220+01 
0.296410+01 
0.76748D-02 
-0. 29047D— 05 
-0.956400+00 
0.243260+00 
0.232910-03 
— 0. 39388D— 08 
-0.152660-01 
0.136710-03 
0.610190-04 

0.128270+00 

0.126530-03 

0.864290-03 

-0.303910-04 

0.816530-04 

0.275630-02 

-0.101930-04 

0.620420-03 

-0.124970-06 

-0.833720-05 

-0.169790-02 

0.778950+00 

-0.141070-03 

0.263830-02 

-0.544480-03 

0.22327D-07 


79 


r ^ 


32 

1 

RNt»6 

0. 1006+01 

-0.129310-04 

2 

SWP 

0.1006+01 

33 

1 

T/W 

0.100fc+01 

-0.442850-04 

2 

T4 

0. 1006+01 

34 

1 

T/W 

O.lOOE^Ol 

0.240620-02 

2 

SWP 

0. 100E+01 

35 

1 

T4 

0.100E+01 

0.203740-06 

2 

SWP 

0. 100E+01 

CALCULATE  TOGW  FROM  RANGE  REGRESS  OR  VICE  VERSA 


CALCULATE  SELECTED  VARIABLE  ( TOGW, RANGE .OTHER  VARIABLE)  USING 
QUADRATIC  SOLUTION 


i 

t 

jf 


YOBS 

YCALC 

DEL 

PERCENT 

PT  NO 

1 

148.900 

145.074 

-3.826 

-2.57 

10 

2 

17.970 

13.407 

-4.563 

-25.39 

13 

3 

63.950 

71.828 

7.878 

12.32 

15 

4 

-24.970 

-26.414 

-1.444 

5.78 

16 

5 

117.700 

120.895 

3.195 

2.71 

20 

6 

25.260 

21.685 

-3.575 

-14.15 

21 

7 

55.090 

60.216 

5.126 

9.31 

23 

8 

-49.960 

-54.622 

-4.662 

9.33 

26 

9 

-70.190 

-69.063 

1.127 

-1.61 

28 

10 

47.020 

49.968 

2.948 

6.27 

29 

11 

12.530 

10.696 

-1.834 

-14.64 

31 

12 

198.100 

198.042 

-0.058 

-0.03 

34 

13 

-40.580 

-43.571 

-2.991 

7.37 

36 

14 

91.610 

84.050 

-7.560 

-8.25 

39 

15 

11.910 

14.700 

2.790 

23.43 

41 

16 

94.180 

103.651 

9.471 

10.06 

42 

17 

93.870 

87.773 

-6.097 

-6.49 

49 

18 

-2.207 

-1.436 

0.771 

-34.94 

55 

19 

148.000 

139.485 

-8.515 

-5.75 

58 

20 

69.390 

66.507 

-2.883 

-4.15 

60 

21 

-39.160 

-35.081 

4.079 

-10.42 

61 

22 

126.000 

122.492 

-3.508 

-2.78 

64 

23 

21.370 

18.384 

-2.986 

-13.97 

65 

24 

-58.380 

-58.860 

-0.480 

0.82 

67 

25 

59.660 

68.593 

8.933 

14.97 

70 

26 

106.000 

113.316 

7.316 

6.90 

73 

27 

31.430 

30.322 

-1.108 

-3.52 

74 

28 

-19.450 

-21.223 

-1.773 

9.11 

76 

29 

105.500 

105.087 

-0.413 

-0.39 

79 

30 

21.100 

20.107 

-0.993 

-4.70 

80 

31 

159.500 

165.679 

6.179 

3.87 

83 

32 

68.640 

64.084 

-4.556 

-6.64 

85 

33 

-53.140 

-47.442 

5.698 

-10.72 

86 

34 

95.000 

103.160 

8.160 

8.59 

88 

35 

84.840 

82.818 

-2.021 

-2.38 

89 

36 

96.170 

97.718 

1.548 

1.61 

90 

37 

124.700 

130.634 

5.934 

4.76 

91 

38 

80.920 

81.294 

0.374 

0.46 

92 

39 

12.510 

27.462 

14.952 

119.52 

93 

40 

105.500 

104.368 

-1.132 

-1.07 

94 

41 

161.200 

171.090 

9.890 

6.14 

95 

42 

121.000 

112.529 

-8.471 

-7.00 

96 

43 

67.060 

55.310 

-11.750 

-17.52 

97 

44 

103.800 

94.760 

-9.040 

-8.71 

98 

45 

100.700 

91.970 

-8.730 

-8.67 

99 

46 

107.200 

105.915 

-1.285 

-1.20 

100 

47 

3.351 

1.643 

-1.708 

-50.98 

101 

81 


48 

185.300 

184.305 

-0.995 

-0.54 

104 

49 

49.790 

52.875 

3.085 

6.20 

106 

50 

-65.310 

-62.205 

3.105 

-4.75 

107 

51 

161.100 

147.950 

-13.149 

-8.16 

110 

52 

25.080 

23.923 

-1.157 

-4.61 

111 

53 

-90.990 

-90.523 

0.467 

-0.51 

113 

54 

52.970 

50.438 

-2.532 

-4.78 

116 

55 

127.700 

127.745 

0.045 

0.04 

118 

56 

34.770 

33.459 

-1.311 

-3.77 

119 

57 

-41.190 

-48.217 

-7.027 

17.06 

121 

58 

89.140 

92.795 

3.655 

4.10 

124 

59 

4.056 

9.827 

5.771 

142.29 

125 

60 

190.200 

193.368 

3.168 

1.67 

128 

61 

31.700 

32.438 

0.738 

2.33 

130 

62 

-94.630 

-90.848 

3.782 

-4.00 

131 

63 

105.500 

104.368 

-1.132 

-1.07 

133 

64 

127.600 

118.100 

-9.500 

-7.44 

135 

65 

17.450 

20.411 

2.961 

16.97 

136 

66 

-57.560 

-60.002 

-2.442 

4.24 

138 

67 

86 .600 

90.524 

3.925 

4.53 

141 

68 

-0.438 

3.203 

3.641 

-831.07 

MAX 

142 

69 

192.400 

217.552 

25.152 

HAX  13.07 

145 

70 

21.860 

34.334 

12.474 

57.06 

147 

71 

-81.970 

-95.977 

-14.007 

17.09 

148 

72 

16.640 

15.465 

-1.175 

-7.06 

150 

73 

183.300 

185.218 

1.918 

1.05 

153 

74 

66.970 

72.112 

5.142 

7.68 

155 

75 

-38.040 

-35.598 

2.442 

-6.42 

156, 

76 

148.200 

143.950 

-4.250 

-2.87 

159 

77 

35.560 

31.922 

-3.638 

-10.23 

160 

78 

-74.060 

-70.688 

3.372 

-4.55 

162 

79 

78.210 

66.125 

-12.085 

-15.45 

165 

AVG 

DEL  SEE  AVG 

PERCENT 

PEE 

R2 

4.73 

8.64 

22.08 

131.01  0 

.0 

82 


CALCULATE  TOGW  FROM  RANGE  REGRESS  OR  VICE  VERSA 
CHECK  POINTS 


! 


f 


i 


s 

I 


i 


YOBS  YCALC  DEL  PERCENT 


1 

34.470 

26.596 

-7.874 

-22.84 

2 

104.600 

110.956 

6.356 

6.08 

3 

-21.370 

-28.677 

-7.307 

34.19 

4 

87.470 

93.085 

5.615 

6.42 

5 

14.100 

13.469 

-0.631 

-4.47 

6 

132.200 

154.045 

21.845 

16.52 

7 

-64.300 

-61.992 

2.308 

-3.59 

8 

47.860 

49.922 

2.062 

4.31 

9 

66.870 

63.432 

-3.438 

-5.14 

10 

-63.450 

-61.637 

1.813 

-2.86 

11 

124.100 

126.907 

2.807 

2.26 

12 

26.860 

20.656 

-6.204 

-23.10 

13 

66.260 

61.460 

-4.799 

-7.24 

14 

-49.610 

-42.000 

7.610 

-15.34 

15 

149.100 

140.919 

-8.181 

-5.49 

16 

-0.096 

-2.047 

-1.951 

2035.05  MAX 

17 

93.290 

102.057 

8.767 

9.40 

18 

4.312 

15.189 

10.877 

252.25 

19 

-35.200 

-38.365 

-3.165 

8.99 

20 

92.960 

91.347 

-1.613 

-1.73 

21 

8.618 

7.813 

-0.805 

-9.35 

22 

182.700 

164.118 

-18.582 

-10.17 

23 

41.320 

52.874 

11.554 

27.96 

24 

-65.160 

-64.734 

0.426 

-0.65 

25 

13.450 

15.759 

2.309 

17.16 

26 

152.400 

149.248 

-3.152 

-2.07 

27 

69.360 

80.409 

11.049 

15.93 

28 

-22.970 

-16.801 

6.169 

-26.86 

29 

126.100 

128.631 

2.531 

2.01 

30 

37.330 

30.574 

-6.756 

-18.10 

31 

-40.030 

-42.767 

-2.737 

6.84 

32 

91.540 

79.060 

-12.480 

-13.63 

33 

126.400 

122.194 

-4.206 

-3.33 

34 

19.490 

21.658 

2.1 68 

11.13 

35 

-69.640 

-64.532 

5.108 

-7.34 

36 

83.490 

83.988 

0.498 

0.60 

37 

4.798 

7.900 

3.102 

64.65 

38 

222.600 

230.946 

8.346 

3.75 

39 

24.690 

32.674 

7.984 

32.34 

40 

-88.930 

-99.344 

-10.414 

11.71 

41 

17.840 

14.039 

-3.801 

-21.31 

42 

179.200 

182.083 

2.884 

1.61 

43 

58.920 

63.802 

4.882 

8.29 

44 

-39.940 

-44.926 

-4.986 

12.48 

45 

123.000 

136.304 

13.304 

10.82 

46 

21.250 

23.107 

1.857 

8.74 

47 

-85.180 

-82.335 

2.845 

-3.34 

48 

59.310 

45.947 

-13.363 

-22.53 

83 


PT  NO 

11. 

12. 
14. 
17. 
19. 
22. 

24. 

25. 
27. 
30. 

32. 

33. 

37. 

38. 
40. 
43. 

56. 

57. 
59. 
62. 
63. 
66. 
68. 
69. 
72. 
75. 

77. 

78. 
81. 
82. 
84. 
87. 

102. 

103. 

105. 

108. 

109. 

112. 

114. 

115. 
117. 
120. 
122. 
123. 
126. 
127. 
129. 
132. 


1.408 

184.200 
55.310 

—53.830 

138.900 

17.920 

-83.380 

48.040 

131.200 
33.890 

-39.570 

114.100 

11.050 

212.000 

51.660 

-74.920 


-0.042 

178.360 
56.993 

-55.894 

140.075 

19.432 

-88.698 

54.394 

128.922 

36.302 

-41.218 

105.360 
16.031 

207.458 

46.881 

-76.328 


-1.450 
-5.840 
1.683 
—2.06* 
1.175 
1.512 
-5.318 
6.354 
-2.278 
2 .<+12 
-1.648 
-8.740 
4.981 
-4.542 
-4.779 
-1.408 


-102.95 
-3.17 
3.04 
3.83 
0.85 
8.44 
6.38 
13.23 
-1.74 
7.12 
4.16 
—7 . 6t> 
45.07 
-2.14 
-9.25 
1.88 


134. 

137. 

139. 

140. 

143. 

144. 
146. 
149. 

151. 

152. 
154. 

157. 

158. 
161. 
le>3  . 
1 64  * 


AVG  DEL 


CUMMULAT IV6 
SEE  AVG  PERCENT 


4.99 


7.60 


33.62 


215.50 


84 


CALCULATE  TOGM  FROM  RANGE  REGRESS  OR  VICE  VERSA 


CHECK  POINTS 


YOBS 

YCALC 

DEL 

PERCENT 

1 

85.170 

86.278 

1.108 

1.30 

2 

5.605 

17.454 

11.849 

211.40 

3 

104.300 

107.691 

3.391 

3.25 

4 

131.100 

143.244 

12.144 

9.26 

5 

44.720 

44.633 

-0.087 

-0.19 

6 

53.480 

60 . 660 

7.180 

13.43 

7 

65.920 

68.307 

2.387 

3.62 

8 

81.310 

81.335 

0.025 

0.03 

9 

97.430 

90.040 

-7.390 

-7.59 

10 

75.080 

73.541 

-1.539 

-2.05 

11 

82.890 

69.279 

-13.611 

-16.42 

12 

79.510 

67.738 

-11.772 

-14.81 

13 

86.250 

81.573 

-4.677 

-5.42 

14 

108.900 

107.442 

-1.458 

-1.34 

15 

72.360 

69.394 

-2.966 

-4.10 

16 

10.470 

18.900 

8.430 

80.52 

17 

142.800 

144.796 

1.996 

1.40 

18 

108.300 

92.034 

-16.265 

-15.02 

19 

63.480 

47.835 

-15.645 

-24.6  5 

20 

93.100 

79.793 

-13.306 

-14.29 

21 

91.180 

77.857 

-13.323 

-14.61 

22 

94.940 

89.566 

-5.374 

-5.66 

AVG  DEL 

CUHMULATIVE 

SEE  AVG  PERCENT 

PEE 

5.27 

7.84  31.87 

197.32 

' i 
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